-- Logs begin at Mon 2022-05-23 14:39:50 UTC, end at Mon 2022-05-23 15:50:20 UTC. -- May 23 15:20:38.529896 dv-cinder-841125-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 15:20:38.538493 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 15:20:38.540527 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 15:20:38 2022] *** May 23 15:20:38.540527 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 15:20:38.540527 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 15:20:38.540527 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: nodename: dv-cinder-841125-8-iscsi May 23 15:20:38.540527 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: machine: x86_64 May 23 15:20:38.540527 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: clock source: unix May 23 15:20:38.540527 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: pcre jit disabled May 23 15:20:38.540527 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: detected number of CPU cores: 4 May 23 15:20:38.540527 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: current working directory: / May 23 15:20:38.540527 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: detected binary path: /usr/bin/uwsgi-core May 23 15:20:38.540527 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: your processes number limit is 47680 May 23 15:20:38.540527 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: your memory page size is 4096 bytes May 23 15:20:38.540527 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: detected max file descriptor number: 2048 May 23 15:20:38.540527 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: lock engine: pthread robust mutexes May 23 15:20:38.541575 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: thunder lock: enabled May 23 15:20:38.541575 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 15:20:38.541575 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 15:20:38.585049 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: Python main interpreter initialized at 0x55a4d66279c0 May 23 15:20:38.585049 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: python threads support enabled May 23 15:20:38.585049 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: your server socket listen backlog is limited to 100 connections May 23 15:20:38.585049 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: your mercy for graceful operations on workers is 90 seconds May 23 15:20:38.585380 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: mapped 403077 bytes (393 KB) for 2 cores May 23 15:20:38.585457 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: *** Operational MODE: preforking *** May 23 15:20:38.585709 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: *** uWSGI is running in multiple interpreter mode *** May 23 15:20:38.585709 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: spawned uWSGI master process (pid: 103338) May 23 15:20:38.585891 dv-cinder-841125-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 15:20:38.587257 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: spawned uWSGI worker 1 (pid: 103339, cores: 1) May 23 15:20:38.587257 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: spawned uWSGI worker 2 (pid: 103340, cores: 1) May 23 15:20:38.587257 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 15:20:39.769122 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 15:20:39.781997 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 15:20:40.493921 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:20:40.493921 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: from cryptography.utils import int_from_bytes May 23 15:20:40.494239 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:20:40.494239 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: from cryptography.utils import int_from_bytes May 23 15:20:40.495278 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:20:40.495278 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: from cryptography.utils import int_from_bytes May 23 15:20:40.495625 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:20:40.495625 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: from cryptography.utils import int_from_bytes May 23 15:20:43.075600 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 15:20:43.076150 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 15:20:43.076361 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 15:20:43.077340 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 15:20:43.077672 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 15:20:43.077827 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 15:20:43.078198 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.078289 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 15:20:43.078384 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.078603 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 15:20:43.078704 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.078974 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 15:20:43.079069 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.079230 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 15:20:43.079323 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.079602 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.079701 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.079920 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.080007 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.080236 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.080321 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.080556 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.080655 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.080810 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.080927 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.081149 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.081243 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.081471 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841125-8-iscsi {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.081560 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.081791 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.081888 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.082096 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.082193 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.082385 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.082482 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.082704 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.082802 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.083003 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.083099 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841125-8-iscsi {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.083320 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.083415 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.083626 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.083713 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.083936 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.084116 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.084514 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.084652 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.084773 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.084918 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.085048 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.085169 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.085286 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.085483 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.085669 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.085823 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.085966 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.086096 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.086276 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.086409 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.086585 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.086720 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.086921 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.087051 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.087238 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.087395 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.087603 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.087748 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841125-8-iscsi {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.087880 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.087993 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.088154 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.088288 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.088477 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.088612 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.088792 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.088956 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.089216 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841125-8-iscsi {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.089345 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.089533 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.089668 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.089848 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.089997 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.090161 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.090295 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.090465 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.090603 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.090788 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.090928 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.091105 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.091240 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.091419 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.091557 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.091734 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.091870 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.092033 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.092721 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.092974 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.093159 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.093296 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.093609 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.093742 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.093931 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.094072 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.094234 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.094363 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.094542 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.094671 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.094800 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.094935 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.095092 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.095227 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.095415 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.095549 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.095736 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.095873 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.096004 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.096137 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.096265 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.096388 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.096524 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.096655 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.096825 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.096978 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.097170 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.097306 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.097441 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.097572 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.097718 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.097911 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.098037 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.098171 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.098301 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.098436 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.098591 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.098729 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.098905 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.099120 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.099301 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.099425 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.099554 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.099691 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.099814 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.099946 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.100092 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.100226 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.100399 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.100534 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.100705 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.100843 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.101043 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.101171 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.101359 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.101493 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.101678 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.101806 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.101984 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.102111 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.102303 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.102438 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.102618 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.102746 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.102926 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.103063 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.103233 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.103366 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.103549 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.103682 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.103854 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.103986 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.104159 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.104295 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.104463 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.104589 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.104780 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.104936 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.105108 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.105243 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.105415 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.105549 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.105688 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.105812 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.105949 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.106085 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.106239 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.106380 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.106556 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.106684 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.106860 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.107001 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.107161 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.107289 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.107463 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.107597 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.107793 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.107943 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.108134 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.108266 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.108388 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.108517 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.108693 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.108821 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.109024 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.109154 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.109334 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.109461 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.109641 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.109800 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.109938 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.110071 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.110243 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.110371 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.110552 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.110681 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.110857 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.110985 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.111164 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.111298 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.111465 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.111598 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.111768 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.111898 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.112069 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.112205 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.112374 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.112502 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.112688 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.112820 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.113014 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.113140 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.113319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.113454 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.113624 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.113765 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.113927 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.114053 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.114231 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.114359 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.114536 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.114661 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.114839 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.114971 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.115141 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.115275 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.115446 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.115584 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.115741 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.115884 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.116045 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.116185 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.116348 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.116482 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.116650 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.116785 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.116981 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.117107 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.117267 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.117402 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.117568 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.117697 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.117869 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.118005 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.118175 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.118308 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.118477 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.118594 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.118775 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.118870 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.119072 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.119159 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.119374 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.119472 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.119678 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.119765 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.119984 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.120082 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.120285 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.120380 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.120586 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.120671 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.120929 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.121020 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.121241 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.121330 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.121813 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.121906 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.122123 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.122210 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.122442 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:20:43.122531 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.122778 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.122863 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.123105 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.123202 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.123455 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.123553 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.123767 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.123852 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.124081 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.124185 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.124404 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.124490 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.124713 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.124813 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.125051 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.125163 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.125359 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.125446 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.125675 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.125762 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.125986 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.126084 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.126300 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.126405 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.126614 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.126736 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.126926 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.127022 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.127241 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.127337 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.127550 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.127642 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.127865 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.127964 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.128180 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.128265 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.128497 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.128591 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.128803 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.128922 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.129144 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.129245 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.129474 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.129567 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.129799 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.129885 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.130109 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.130194 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.130427 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.130519 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.130738 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.130825 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.131047 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.131145 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.131357 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.131451 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.131678 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.131765 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.132010 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.132102 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.132319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.132411 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.132630 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.132715 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.132961 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.133061 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.133274 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.133370 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.133586 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.133672 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.133896 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.133983 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.134206 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.134300 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.134520 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.134616 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.134832 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.134926 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.135145 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.135250 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.135452 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.135538 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.135769 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.135855 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.136080 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.136167 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.136389 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.136473 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.136699 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.136785 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.137023 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.137109 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.137330 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.137427 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.137634 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.137718 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.137944 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.138041 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.138243 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.138328 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.138548 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.138640 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.138861 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.139481 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.139713 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.139809 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.140040 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.140135 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.140344 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.140428 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.140653 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.140737 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.140982 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.141089 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.141291 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.141376 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.141596 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.141687 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.141905 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.142003 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.142212 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.142307 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.142516 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.142601 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.142823 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.142917 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.143132 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.143222 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.143435 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.143520 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.143740 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.143833 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.144045 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.144129 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.144347 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.144433 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.144655 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.144742 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.144985 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.145071 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.145298 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.145395 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.145601 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.145688 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.145906 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.145990 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.146215 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.146299 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.146524 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.146609 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.146834 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.146918 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.147144 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.147242 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.147468 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.147553 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.147770 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.147862 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.148082 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.148201 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.148400 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.148492 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.148714 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.148800 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.149047 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.149220 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.149447 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.149658 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.149751 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.149966 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.150064 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.150269 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.150354 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.150575 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.150661 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.150878 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.150971 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.151179 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.151270 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.151481 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.151565 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.151780 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.151872 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.152081 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.152163 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.152386 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.152470 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.152689 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.152780 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.153013 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.153103 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.153314 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.153398 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.153615 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.153701 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.153929 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.154014 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.154233 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.154330 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.154536 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.154653 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.155446 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.155542 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.155765 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.155863 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.156086 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.156181 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.156395 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.156481 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.156709 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.156799 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.157042 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.157131 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.157353 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.157439 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.157663 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.157760 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.157971 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.158056 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.158290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.158387 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.158599 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.158721 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.158910 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.158995 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.159215 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.159306 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.159535 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.159628 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.159846 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.159929 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.160163 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.160248 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.160464 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.160549 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.160777 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.160883 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.161111 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.161196 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.161434 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.161522 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.161743 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.161829 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.162059 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.162153 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.162366 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.162452 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.162679 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.162763 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.162986 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.163079 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.163294 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.163379 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.163600 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.163684 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.163907 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.164004 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.164224 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.164317 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.164532 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.164618 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.164841 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.164985 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.165171 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.165263 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.165487 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.165572 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.165792 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.165888 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.166106 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.166205 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.166408 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.166492 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.166720 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.166808 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.167027 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.167119 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.167345 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.167431 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.167650 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.167737 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.167955 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.168040 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.168272 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.168359 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.168580 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.168674 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.168906 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.168995 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.169217 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.169301 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.169521 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.169616 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.169830 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.169916 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.170137 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.170248 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.170473 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.170558 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.170782 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.170892 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.171088 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.171209 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.171399 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.171517 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.171713 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.171830 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.172023 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.172138 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.172333 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.172440 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.172640 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.172741 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.172982 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.173083 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.173295 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.173380 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.173599 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.173684 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.173903 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.174003 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.174214 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.174300 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.174535 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.174620 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.174844 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.174932 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.175161 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.175257 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.175470 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.175598 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.175773 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.175868 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.176074 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.176160 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.176377 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.176469 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.176691 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.176777 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.177018 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.177108 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.177320 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.177406 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.177625 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.177714 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.177940 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.178032 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.178249 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.178410 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.178556 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.178641 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.178861 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.178945 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.179169 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.179264 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.179480 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.179573 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.179793 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.179877 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.180099 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.180197 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.180407 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.180500 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.180711 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.180861 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.181042 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.181143 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.181350 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.181443 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.181660 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.181746 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.181964 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.182051 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.182272 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.182356 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.182576 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.182660 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.182879 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.182966 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.183185 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.183269 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.183494 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.183581 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.183804 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.184053 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.184140 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.184383 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.184469 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.184696 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.184795 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.185038 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.185279 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.185365 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.185614 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.185761 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.185957 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.186132 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.186274 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.186719 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.186807 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.187121 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.187222 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.187389 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.187489 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.187719 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.187806 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.188030 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.188129 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.188338 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.188436 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.188650 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.188735 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.188978 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.189067 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.189283 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.189371 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.189586 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.189672 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.189889 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.189974 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.190190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.190275 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.190491 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.190576 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.190792 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.190876 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.191095 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.191181 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.191401 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.191486 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.191701 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.191785 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.192005 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.192099 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.192305 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.192389 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.192610 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.192758 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.192940 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.193028 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.193242 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.193328 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.193543 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.193641 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.193844 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.193942 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.194151 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.194243 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.194455 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.194550 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.194758 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.194844 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.195099 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.195193 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.195406 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.195501 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.195723 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.195852 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.196025 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.196112 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.196344 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.196432 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.196647 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.196732 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.196972 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.197061 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.197272 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.197368 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.197579 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.197664 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.197885 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.197972 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.198187 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.198273 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.198492 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.198622 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.198798 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.198895 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.199101 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.199187 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.199407 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.199493 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.199711 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.199806 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.200018 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.200102 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.200315 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.200407 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.200615 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.200710 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.200941 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.201028 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.201246 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.201335 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.202166 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.202274 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.202606 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.202693 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.202916 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.203008 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.203218 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.203377 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.203529 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.203614 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.203829 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.203913 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.204132 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.204225 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.204437 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.204529 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.204740 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.204832 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.205067 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.205157 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.205376 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.205462 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.205682 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.205770 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.205982 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.206075 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.206291 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.206376 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.206599 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.206683 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.206903 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.206989 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.207201 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.207293 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.207509 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.207604 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.207814 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.207901 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.208115 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.208199 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.208420 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.208512 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.208723 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.208817 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.209052 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.209139 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.209358 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.209455 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.209668 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.209753 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.209970 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.210056 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.210277 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.210370 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.210577 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.210663 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.210880 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.210965 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.211177 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.211262 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.211477 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.211570 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.211779 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.211864 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.212080 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.212167 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.212379 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.212463 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.212682 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.212766 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.213009 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.213101 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.213314 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.213398 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.213614 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.213699 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.213913 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.214001 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.214221 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.214306 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.214526 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.214621 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.214828 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.214922 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.215172 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.215264 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.215478 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.215577 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.215792 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.215876 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.216102 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.216187 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.216412 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.216506 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.216724 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.216817 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.217078 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.217232 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.217453 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.217550 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.217772 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.217900 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.218080 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.218215 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.218398 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.218521 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.218712 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.218842 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.219029 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.219123 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.219337 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.219425 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.219645 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.219732 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.219974 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.220059 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.220287 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.220375 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.220600 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.220685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.220946 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.221048 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.221265 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.221352 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.221574 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.221659 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.221883 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.221968 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.222192 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.222279 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.222497 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.222581 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.222803 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.222901 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.223112 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.223199 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.223417 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.223510 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.223725 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.223825 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.224033 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.224126 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.224337 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.224430 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.224644 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.224739 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.224973 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.225062 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.225279 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.225364 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.225587 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.225690 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.225895 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.225979 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.226200 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.226292 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.226505 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.226591 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.226807 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.226893 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.227116 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.227202 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.227418 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.227504 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.227722 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.227841 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.228034 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.228152 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.228344 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.228463 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.228766 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.228850 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.229097 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.229201 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.229407 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.229499 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.229712 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.229797 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.230020 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.230113 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.230327 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.230424 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.230640 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.230726 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.230954 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.231048 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.231261 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.231350 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.231623 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.231708 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.231925 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.232093 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.232226 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.232312 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.232530 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.232624 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.233420 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.233607 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.233740 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.233826 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.234009 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.234096 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.234312 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.234400 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.234626 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.234721 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.234926 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.235011 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.235228 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.235316 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.235550 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.235636 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.235857 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.235951 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.236179 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.236275 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.236598 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.236685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.236929 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.237034 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.237237 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.237322 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.237558 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.237693 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.237875 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.237975 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.238198 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.238314 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.238500 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.238594 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.238810 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.238905 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.239116 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.239223 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.239437 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.239523 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.239756 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.239841 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.240064 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.240164 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.240375 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.240462 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.240679 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.240764 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.241020 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.241124 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.241337 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.241423 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.241644 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.241739 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.241961 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.242062 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.242282 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.242369 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.242598 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.242685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.242920 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.243010 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.243280 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.243414 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.243602 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.243689 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.243906 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.243995 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.244208 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.244295 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.244514 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.244599 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.244815 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.244923 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.245151 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.245237 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.245471 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.245570 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.245773 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.245867 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.246078 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.246162 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.246381 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.246474 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.246949 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.247036 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.247252 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.247344 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.247553 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.247649 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.247860 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.247946 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.248160 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.248247 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.249120 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.249234 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.249456 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.249564 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.249761 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.249849 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.250081 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.250176 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.250387 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.250525 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.250708 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.250804 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.251021 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.251109 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.251325 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.251411 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.251629 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.251715 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.251931 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.252018 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.252236 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.252321 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.252544 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.252637 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.252850 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.252958 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.253202 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.253289 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.253507 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.253601 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.253822 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.253906 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.254150 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.254236 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.254470 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.254563 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.254782 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.254878 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.255095 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.255180 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.255415 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.255511 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.255717 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.255805 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.256019 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.256105 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.256327 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.256468 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.256628 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.256716 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.256952 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.257043 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.257255 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.257350 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.257557 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.257655 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.257855 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.257940 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.258155 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.258249 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.258454 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.258540 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.258755 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.258847 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.259060 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.259146 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.259360 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.259445 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.259669 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.259761 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.259971 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.260058 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.260271 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.260356 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.260573 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.260671 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.260897 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.260986 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.261207 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.261295 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.261510 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.261605 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.261842 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.261927 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.262144 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.262230 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.262468 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.262565 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.262774 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.262861 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.263092 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.263180 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.263403 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.263502 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.263713 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.263799 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.264048 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.264171 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.264358 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.264457 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.264670 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.264807 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.265005 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.265162 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.265318 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.265480 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.265623 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.265797 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.265933 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.266113 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.266243 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.266430 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.266556 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.266741 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.267056 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.267142 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.267371 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.267460 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.267690 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.267776 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.268002 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.268211 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.268300 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.268541 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.268636 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.268859 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.268976 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.269192 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.269288 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.269506 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.269594 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.269821 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.269907 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.270128 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.270214 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.270446 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.270532 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.270757 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.270843 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.271067 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.271162 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.271377 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.271470 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.271702 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.271796 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.272017 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.272110 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.272331 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.272416 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.272646 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.272813 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.272990 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.273078 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.273306 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.273393 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.273617 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.273752 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.273929 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.274015 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.274238 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.274324 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.274551 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.274639 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.274861 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.274947 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.275170 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.275264 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.275480 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.275567 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.275790 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.275875 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.276095 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.276189 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.276403 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.276496 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.276715 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.276802 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.277047 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.277147 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.277356 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.277449 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.277666 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.277759 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.277977 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.278113 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.278285 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.278378 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.278596 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.278682 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.278908 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.279008 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.279231 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.279421 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.279564 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.279851 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.279996 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.280189 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.280339 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.280514 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.280846 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.280961 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.281185 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.281271 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.281502 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.281587 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.281829 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.281934 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.282137 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.282224 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.282441 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.282535 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.282750 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.282849 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.283060 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.283148 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.283363 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.283458 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.283677 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.283813 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.283982 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.284077 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.284286 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.284382 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.284590 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.284677 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.284915 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.285004 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.285240 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.285445 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.285540 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.285785 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.285878 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.286100 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.286185 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.286423 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.286667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.286763 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.287042 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.287138 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.287322 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.287413 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.287646 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.287732 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.287951 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.288037 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.288255 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.288350 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.288567 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.288653 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.288883 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.288981 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.289200 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.289296 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.289504 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.289590 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.289813 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.289899 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.290119 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.290214 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.290423 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.290519 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.290726 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.290812 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.291028 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.291123 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.291334 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.291419 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.291641 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.291726 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.291940 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.292032 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.292241 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.292334 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.292550 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.292636 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.292853 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.292994 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.293177 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.293263 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.293480 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.293566 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.293781 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.293913 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.294087 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.294175 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.294387 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.294471 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.294690 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.294777 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.294993 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.295078 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.295837 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.295945 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.296140 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.296234 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.296448 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.296535 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.296794 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.296907 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.297142 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.297228 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.297447 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.297534 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.297751 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.297850 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.298066 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.298152 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.298374 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.298459 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.298693 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.298788 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.299003 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.299099 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.299311 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.299397 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.299621 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.299708 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.299946 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.300039 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.300261 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.300473 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.300568 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.300806 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.300942 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.301157 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.301243 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.301488 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.301759 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.301847 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.302094 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.302181 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.302403 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.302488 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.302709 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.302806 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.303030 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.303116 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.303338 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.303433 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.303644 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.303738 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.303950 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.304036 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.304255 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.304350 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.304561 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.304648 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.304883 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.304972 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.305193 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.305292 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.305501 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.305586 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.305804 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.305896 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.306112 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.306200 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.306416 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.306508 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.306723 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.306817 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.307030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.307117 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.307341 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.307434 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.307650 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.307736 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.307960 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.308048 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.308271 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.308356 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.308584 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.308678 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.308913 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.309015 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.309225 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.309319 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.309534 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.309628 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.309840 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.309926 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.310149 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.310235 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.310462 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.310563 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.310771 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.310911 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.311740 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.311893 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.312070 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.312404 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.312494 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.312723 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.312811 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.313057 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.313161 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.313407 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.313493 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.313718 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.313804 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.314041 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.314136 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.314364 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.314452 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.314674 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.314760 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.314994 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.315089 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.315304 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.315390 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.315616 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.315702 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.315940 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.316031 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.316251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.316345 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.316574 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.316659 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.316890 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.316979 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.317208 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.317294 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.317515 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.317600 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.317824 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.317913 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.318141 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.318234 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.318446 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.318590 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.318746 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.318840 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.319046 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.319132 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.319350 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.319444 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.319650 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.319774 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.319951 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.320065 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.320250 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.320376 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.320549 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.320637 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.320852 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.320958 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.321173 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.321271 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.321475 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.321560 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.321774 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.321860 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.322074 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.322168 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.322373 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.322459 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.322674 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.322759 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.322974 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.323061 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.323273 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.323358 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.323573 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.323658 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.323870 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.323965 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.324171 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.324256 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.324469 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.324566 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.324771 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.324898 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.325098 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.325196 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.325402 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.325536 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.325779 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.325875 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.326041 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.326127 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.326360 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.326498 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.326693 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.326780 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.327014 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.327122 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.327326 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.327421 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.327632 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.327718 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.327938 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.328022 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.328263 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.328357 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.328568 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.328653 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.328890 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.328997 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.329207 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.329294 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.329513 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.329599 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.329819 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.329905 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.330126 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.330213 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.330434 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.330519 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.330747 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.330834 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.331047 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.331135 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.331372 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.331459 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.331685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.331847 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.331989 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.332076 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.332301 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.332388 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.332609 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.332704 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.332945 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.333047 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.333253 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.333338 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.333560 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.333655 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.333872 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.333959 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.334179 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.334264 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.334485 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.334579 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.334798 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.334900 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.335101 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.335189 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.335413 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.335509 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.335727 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.335821 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.336031 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.336117 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.336354 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.336441 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.336677 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.336763 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.337010 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.337118 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.337338 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.337426 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.337664 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.337752 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.337985 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.338079 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.338296 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.338396 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.338606 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.338733 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.338909 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.339005 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.339147 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 15:20:43.339254 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.339567 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.339872 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:20:43.340114 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 15:20:43.397632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO dbcounter [None req-603e9d62-5a5c-4055-894c-8a4c468686ef None None] Registered counter for database nova_api May 23 15:20:43.398847 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO dbcounter [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] Registered counter for database nova_api May 23 15:20:43.419650 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG oslo_db.sqlalchemy.engines [None req-603e9d62-5a5c-4055-894c-8a4c468686ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:20:43.421972 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_db.sqlalchemy.engines [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:20:43.427117 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writer thread running {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:20:43.428473 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writer thread running {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:20:43.483090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.context [None req-603e9d62-5a5c-4055-894c-8a4c468686ef None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f40d0327-0eaf-46c7-bb5c-33377a3083ec(cell1) {{(pid=103340) load_cells /opt/stack/nova/nova/context.py:464}} May 23 15:20:43.485987 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.context [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f40d0327-0eaf-46c7-bb5c-33377a3083ec(cell1) {{(pid=103339) load_cells /opt/stack/nova/nova/context.py:464}} May 23 15:20:43.487217 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-603e9d62-5a5c-4055-894c-8a4c468686ef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:20:43.488778 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-603e9d62-5a5c-4055-894c-8a4c468686ef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:20:43.489588 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-603e9d62-5a5c-4055-894c-8a4c468686ef None None] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:20:43.490058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:20:43.491533 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-603e9d62-5a5c-4055-894c-8a4c468686ef None None] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:20:43.491653 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:20:43.492398 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:20:43.493525 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO dbcounter [None req-603e9d62-5a5c-4055-894c-8a4c468686ef None None] Registered counter for database nova_cell0 May 23 15:20:43.494391 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:20:43.496381 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO dbcounter [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] Registered counter for database nova_cell0 May 23 15:20:43.497691 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO dbcounter [None req-603e9d62-5a5c-4055-894c-8a4c468686ef None None] Registered counter for database nova_cell1 May 23 15:20:43.501286 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO dbcounter [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] Registered counter for database nova_cell1 May 23 15:20:43.505615 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG oslo_db.sqlalchemy.engines [None req-603e9d62-5a5c-4055-894c-8a4c468686ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:20:43.507729 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG oslo_db.sqlalchemy.engines [None req-603e9d62-5a5c-4055-894c-8a4c468686ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:20:43.510773 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_db.sqlalchemy.engines [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:20:43.512237 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writer thread running {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:20:43.512476 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_db.sqlalchemy.engines [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:20:43.519164 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writer thread running {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:20:43.521220 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writer thread running {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:20:43.649724 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writer thread running {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:20:43.659590 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO dbcounter [None req-603e9d62-5a5c-4055-894c-8a4c468686ef None None] Registered counter for database nova_cell0 May 23 15:20:43.665971 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO dbcounter [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] Registered counter for database nova_cell0 May 23 15:20:43.666161 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG oslo_db.sqlalchemy.engines [None req-603e9d62-5a5c-4055-894c-8a4c468686ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:20:43.670588 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writer thread running {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:20:43.674571 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_db.sqlalchemy.engines [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:20:43.678822 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writer thread running {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:20:44.014439 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: WARNING keystonemiddleware.auth_token [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 15:20:44.017182 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: WARNING keystonemiddleware.auth_token [None req-603e9d62-5a5c-4055-894c-8a4c468686ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 15:20:44.021737 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: WARNING keystonemiddleware.auth_token [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 15:20:44.024515 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: WARNING keystonemiddleware.auth_token [None req-603e9d62-5a5c-4055-894c-8a4c468686ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 15:20:44.366178 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: WARNING keystonemiddleware.auth_token [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 15:20:44.372452 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: WARNING keystonemiddleware.auth_token [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 15:20:44.376202 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: WARNING keystonemiddleware.auth_token [None req-603e9d62-5a5c-4055-894c-8a4c468686ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 15:20:44.378223 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4d66279c0 pid: 103339 (default app) May 23 15:20:44.380272 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:20:44.381506 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001770 May 23 15:20:44.381923 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Mon May 23 15:20:44 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:20:44.382182 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: WARNING keystonemiddleware.auth_token [None req-603e9d62-5a5c-4055-894c-8a4c468686ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 15:20:44.387631 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4d66279c0 pid: 103340 (default app) May 23 15:22:02.670639 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:02.672455 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 May 23 15:22:02.678481 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 15:22:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:22:02.686353 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=3 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:02.687962 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell0:SELECT=3 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:02.689130 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell1:SELECT=3 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:02.690041 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:03.152806 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-707bca90-c6f8-4441-91c5-0ecfd23f055e admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:03.183815 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-707bca90-c6f8-4441-91c5-0ecfd23f055e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.503146 May 23 15:22:03.184626 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1291 bytes} [Mon May 23 15:22:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:22:05.471001 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:05.472007 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-2729707e-669c-4274-bf10-deb2cd52537a None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 23 15:22:05.472404 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 15:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:22:05.535704 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-f53b430b-9554-415e-9b49-97b27670c66f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "id": "c1", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:05.553981 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:22:05.553981 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: warnings.warn(msg) May 23 15:22:05.583993 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-f53b430b-9554-415e-9b49-97b27670c66f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105433 May 23 15:22:05.584588 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 15:22:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:22:05.599422 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writing DB stats nova_api:SELECT=3 {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:05.600581 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writing DB stats nova_cell1:SELECT=3 {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:05.601910 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writing DB stats nova_cell0:SELECT=3 {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:05.602785 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:05.816056 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-6ac15661-3844-4974-8d0f-97424c611f08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:05.820340 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:22:05.820340 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: warnings.warn(msg) May 23 15:22:05.927815 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-6ac15661-3844-4974-8d0f-97424c611f08 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.334839 May 23 15:22:05.928897 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1335 bytes} [Mon May 23 15:22:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:22:08.369039 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-f53b430b-9554-415e-9b49-97b27670c66f admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:08.371168 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-f53b430b-9554-415e-9b49-97b27670c66f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002789 May 23 15:22:08.371762 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 15:22:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:22:08.479094 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-69c10d9e-595e-4a18-b962-7ebe10365e0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1"}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:08.497425 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:22:08.497425 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: warnings.warn(msg) May 23 15:22:08.515502 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-69c10d9e-595e-4a18-b962-7ebe10365e0c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135781 May 23 15:22:08.516051 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 15:22:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 15:22:08.527689 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-9bef54b8-5bb0-4152-8d49-e29d1b11c75b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:08.529203 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:22:08.529203 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: warnings.warn(msg) May 23 15:22:08.560005 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-9bef54b8-5bb0-4152-8d49-e29d1b11c75b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035892 May 23 15:22:08.560800 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1335 bytes} [Mon May 23 15:22:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:22:10.865495 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-69c10d9e-595e-4a18-b962-7ebe10365e0c admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:10.866436 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-69c10d9e-595e-4a18-b962-7ebe10365e0c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 May 23 15:22:10.867059 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 15:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:22:10.933509 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-943b03dc-462c-49b4-8811-a74c89fa53d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 1024, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:10.952609 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-943b03dc-462c-49b4-8811-a74c89fa53d2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078763 May 23 15:22:10.960741 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 15:22:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:22:10.966086 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-7ef4e81e-6385-46c8-8a1b-3882eb0006b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:10.990174 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-7ef4e81e-6385-46c8-8a1b-3882eb0006b3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027883 May 23 15:22:10.999301 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1335 bytes} [Mon May 23 15:22:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:22:13.293593 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-943b03dc-462c-49b4-8811-a74c89fa53d2 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:13.294538 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-943b03dc-462c-49b4-8811-a74c89fa53d2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 May 23 15:22:13.294943 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 15:22:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:22:13.357242 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-e38029ce-6898-421c-9617-c8a2c1a2149d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G"}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:13.377419 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-e38029ce-6898-421c-9617-c8a2c1a2149d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075804 May 23 15:22:13.378258 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 15:22:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:22:13.390392 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-45986450-ab00-4aac-b426-4edab506d12d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:13.415002 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-45986450-ab00-4aac-b426-4edab506d12d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028593 May 23 15:22:13.415602 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1335 bytes} [Mon May 23 15:22:13 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:22:15.709108 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-e38029ce-6898-421c-9617-c8a2c1a2149d admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:15.710119 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-e38029ce-6898-421c-9617-c8a2c1a2149d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 23 15:22:15.710518 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 15:22:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:22:15.771535 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-dd3f9f77-5ca4-49a4-a179-8484b347238e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:15.790118 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-dd3f9f77-5ca4-49a4-a179-8484b347238e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073266 May 23 15:22:15.790978 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 15:22:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:22:15.803123 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-544232c5-e9e4-4f8c-83b6-83f6b1a8048b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:15.826296 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-544232c5-e9e4-4f8c-83b6-83f6b1a8048b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026896 May 23 15:22:15.827067 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1335 bytes} [Mon May 23 15:22:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:22:18.094736 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-dd3f9f77-5ca4-49a4-a179-8484b347238e admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:18.095882 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-dd3f9f77-5ca4-49a4-a179-8484b347238e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001689 May 23 15:22:18.099524 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 15:22:18 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:22:18.161866 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-48166ecc-8379-46c2-a010-ef2dfc238d89 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:18.185885 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-48166ecc-8379-46c2-a010-ef2dfc238d89 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080043 May 23 15:22:18.186432 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1291 bytes} [Mon May 23 15:22:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:22:20.516518 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-dd3f9f77-5ca4-49a4-a179-8484b347238e admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:20.517579 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-dd3f9f77-5ca4-49a4-a179-8484b347238e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 May 23 15:22:20.517983 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 15:22:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:22:20.581474 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-47b34f76-43b4-4ec7-9b97-f1ffcea70040 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:20.600154 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-47b34f76-43b4-4ec7-9b97-f1ffcea70040 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075992 May 23 15:22:20.600791 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 15:22:20 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:22:20.613778 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-b371c988-2a93-459f-afa4-70a655d1c676 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:20.641720 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-b371c988-2a93-459f-afa4-70a655d1c676 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031655 May 23 15:22:20.642523 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1332 bytes} [Mon May 23 15:22:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:22:23.247117 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-47b34f76-43b4-4ec7-9b97-f1ffcea70040 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:23.248133 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-47b34f76-43b4-4ec7-9b97-f1ffcea70040 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 23 15:22:23.248532 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 15:22:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:22:23.307896 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-77da48fd-905d-40b9-bbf5-fb7c4752bb74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "name": "m1.small", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:23.326274 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-77da48fd-905d-40b9-bbf5-fb7c4752bb74 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071393 May 23 15:22:23.326832 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 15:22:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 15:22:23.339315 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-afd9ee8d-3c36-4904-a6b6-8b6d78b45780 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:23.362301 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-afd9ee8d-3c36-4904-a6b6-8b6d78b45780 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026657 May 23 15:22:23.362875 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1332 bytes} [Mon May 23 15:22:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:22:26.016095 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-77da48fd-905d-40b9-bbf5-fb7c4752bb74 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:26.017784 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-77da48fd-905d-40b9-bbf5-fb7c4752bb74 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002144 May 23 15:22:26.018188 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 15:22:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:22:26.074197 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-4e487d63-c150-4397-8c9e-6e8c17bb5ea2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "rxtx_factor": 1.0, "ram": 4096, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:26.092287 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-4e487d63-c150-4397-8c9e-6e8c17bb5ea2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.068353 May 23 15:22:26.092927 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 15:22:26 2022] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:22:26.104902 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-8f176d44-6f8f-4217-8e33-365cf4b9a960 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:26.127742 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-8f176d44-6f8f-4217-8e33-365cf4b9a960 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026680 May 23 15:22:26.128292 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1332 bytes} [Mon May 23 15:22:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:22:28.396469 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-4e487d63-c150-4397-8c9e-6e8c17bb5ea2 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:28.397516 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-4e487d63-c150-4397-8c9e-6e8c17bb5ea2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 May 23 15:22:28.397919 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 15:22:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:22:28.456959 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-e9657470-e636-411c-b82a-714fad90dc56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "vcpus": 4, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:28.474973 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-e9657470-e636-411c-b82a-714fad90dc56 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071034 May 23 15:22:28.475613 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 15:22:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 15:22:28.488269 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-19603ed3-1606-40a6-ae69-854e1438f4dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:28.512173 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-19603ed3-1606-40a6-ae69-854e1438f4dc admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028306 May 23 15:22:28.512747 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1332 bytes} [Mon May 23 15:22:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:22:30.861407 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-e9657470-e636-411c-b82a-714fad90dc56 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:30.862425 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-e9657470-e636-411c-b82a-714fad90dc56 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 23 15:22:30.863010 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 15:22:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:22:30.932508 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-91f7629b-0e48-4743-a0cb-e4694b5c0580 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:30.955892 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-91f7629b-0e48-4743-a0cb-e4694b5c0580 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.087177 May 23 15:22:30.956540 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1282 bytes} [Mon May 23 15:22:30 2022] POST /compute/v2.1/flavors => generated 408 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:22:30.968446 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-bd75658c-34ea-4dee-b604-5efe5b36a2b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:30.993204 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-bd75658c-34ea-4dee-b604-5efe5b36a2b0 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028421 May 23 15:22:30.993785 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1332 bytes} [Mon May 23 15:22:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:22:54.853995 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-91f7629b-0e48-4743-a0cb-e4694b5c0580 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:54.855013 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-91f7629b-0e48-4743-a0cb-e4694b5c0580 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 23 15:22:54.855408 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 15:22:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:22:54.872461 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:54.920529 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-60d87656-87bf-4b68-8587-20bf67def0a6 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:54.937272 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-60d87656-87bf-4b68-8587-20bf67def0a6 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069500 May 23 15:22:54.937801 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1291 bytes} [Mon May 23 15:22:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:22:55.920584 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-91f7629b-0e48-4743-a0cb-e4694b5c0580 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:55.921621 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-91f7629b-0e48-4743-a0cb-e4694b5c0580 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 23 15:22:55.922015 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 15:22:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:22:56.120037 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-9b31c55a-fc27-413b-bc73-cc2d95e89546 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:56.125729 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.wsgi [None req-9b31c55a-fc27-413b-bc73-cc2d95e89546 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-9b31c55a-fc27-413b-bc73-cc2d95e89546 admin admin] Request method failure captured: May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Accept: application/json May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Accept-Encoding: gzip, deflate May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Connection: keep-alive May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Content-Length: 0 May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Host: 10.222.0.30 May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Openstack-Api-Version: compute 2.90 May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Openstack-System-Scope: None May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: User-Agent: python-novaclient May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Auth-Token: gAAAAABii6bPTNHzmut6tNTPP3C_sEf4zFGsYw7W9ywZgnwe9C4IjDdTos_E8Tq8OzxQEYnR3sTm1gN-a-I2xveG4aMBRtIQHVifYHpkH0G2pREBevyONWufWFS7ML_xt9l8QIvehcmfKt1g1cReQaTou8SwdggJIqUOsFmMkjCzYxefqRq9hpQ May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Domain-Id: None May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Domain-Name: None May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Identity-Status: Confirmed May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Is-Admin-Project: True May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Openstack-Nova-Api-Version: 2.90 May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Project-Domain-Id: default May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Project-Domain-Name: Default May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Project-Id: c586cdfef8dc4cea9cf389817d345b08 May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Project-Name: admin May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Role: admin,member,reader May 23 15:22:56.129290 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Roles: admin,member,reader May 23 15:22:56.130989 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c586cdfef8dc4cea9cf389817d345b08", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:22:56.130989 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Tenant: admin May 23 15:22:56.130989 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Tenant-Id: c586cdfef8dc4cea9cf389817d345b08 May 23 15:22:56.130989 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Tenant-Name: admin May 23 15:22:56.130989 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-User: admin May 23 15:22:56.130989 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-User-Domain-Id: default May 23 15:22:56.130989 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-User-Domain-Name: Default May 23 15:22:56.130989 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-User-Id: 61ee072739a04036a34cf038cd44e02b May 23 15:22:56.130989 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-User-Name: admin May 23 15:22:56.130989 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: method: > May 23 15:22:56.130989 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: exception: Flavor 42 could not be found. May 23 15:22:56.130989 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: action_args: {'id': '42'} May 23 15:22:56.130989 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:22:56.130989 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:22:56.132190 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi May 23 15:22:56.133707 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-9b31c55a-fc27-413b-bc73-cc2d95e89546 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:22:56.134939 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-9b31c55a-fc27-413b-bc73-cc2d95e89546 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061734 May 23 15:22:56.134939 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Mon May 23 15:22:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 15:22:56.140399 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-be01b89e-9bea-4d03-8cd6-a329196c714e admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:56.143690 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:56.164226 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-be01b89e-9bea-4d03-8cd6-a329196c714e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027354 May 23 15:22:56.164785 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Mon May 23 15:22:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:22:56.175307 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-d0c618fe-d726-4094-88c1-1e9be819c335 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:56.196284 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-d0c618fe-d726-4094-88c1-1e9be819c335 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025313 May 23 15:22:56.196819 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Mon May 23 15:22:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:22:56.206545 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-6499d3df-7aca-464a-94b7-dfb46da86c97 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:56.212827 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.wsgi [None req-6499d3df-7aca-464a-94b7-dfb46da86c97 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-6499d3df-7aca-464a-94b7-dfb46da86c97 admin admin] Request method failure captured: May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Accept: application/json May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Accept-Encoding: gzip, deflate May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Connection: keep-alive May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Content-Length: 0 May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Host: 10.222.0.30 May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Openstack-Api-Version: compute 2.90 May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Openstack-System-Scope: None May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: User-Agent: python-novaclient May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Auth-Token: gAAAAABii6bPTNHzmut6tNTPP3C_sEf4zFGsYw7W9ywZgnwe9C4IjDdTos_E8Tq8OzxQEYnR3sTm1gN-a-I2xveG4aMBRtIQHVifYHpkH0G2pREBevyONWufWFS7ML_xt9l8QIvehcmfKt1g1cReQaTou8SwdggJIqUOsFmMkjCzYxefqRq9hpQ May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Domain-Id: None May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Domain-Name: None May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Identity-Status: Confirmed May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Is-Admin-Project: True May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Openstack-Nova-Api-Version: 2.90 May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Project-Domain-Id: default May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Project-Domain-Name: Default May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Project-Id: c586cdfef8dc4cea9cf389817d345b08 May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Project-Name: admin May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Role: admin,member,reader May 23 15:22:56.216072 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Roles: admin,member,reader May 23 15:22:56.217696 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c586cdfef8dc4cea9cf389817d345b08", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:22:56.217696 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Tenant: admin May 23 15:22:56.217696 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Tenant-Id: c586cdfef8dc4cea9cf389817d345b08 May 23 15:22:56.217696 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Tenant-Name: admin May 23 15:22:56.217696 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-User: admin May 23 15:22:56.217696 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-User-Domain-Id: default May 23 15:22:56.217696 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-User-Domain-Name: Default May 23 15:22:56.217696 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-User-Id: 61ee072739a04036a34cf038cd44e02b May 23 15:22:56.217696 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-User-Name: admin May 23 15:22:56.217696 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: method: > May 23 15:22:56.217696 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: exception: Flavor 42 could not be found. May 23 15:22:56.217696 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: action_args: {'id': '42'} May 23 15:22:56.217696 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:22:56.217696 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:22:56.218667 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi May 23 15:22:56.220030 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-6499d3df-7aca-464a-94b7-dfb46da86c97 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:22:56.221798 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-6499d3df-7aca-464a-94b7-dfb46da86c97 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015014 May 23 15:22:56.221798 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Mon May 23 15:22:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 15:22:57.081761 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-d0c618fe-d726-4094-88c1-1e9be819c335 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:57.082777 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-d0c618fe-d726-4094-88c1-1e9be819c335 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 23 15:22:57.083173 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 15:22:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:22:57.284366 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-e545b699-8956-4aea-bd17-9aacd8c07cff admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:57.289751 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.wsgi [None req-e545b699-8956-4aea-bd17-9aacd8c07cff admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-e545b699-8956-4aea-bd17-9aacd8c07cff admin admin] Request method failure captured: May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Accept: application/json May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Accept-Encoding: gzip, deflate May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Connection: keep-alive May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Content-Length: 0 May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Host: 10.222.0.30 May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Openstack-Api-Version: compute 2.90 May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Openstack-System-Scope: None May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: User-Agent: python-novaclient May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Auth-Token: gAAAAABii6bRfeJ5R0e6ZYhMfatIde8Rx0qSPpcf1lbZWFICsFbEKY7y7xNP66rjdaiO6eohK3n-ILIvPJZocf4ucUYibRJR1Q9Ulh768QlncNmE0q0oQjxFwNPh79zm2lpfkl8DBCGHEU0_-MSz041wYZJJWQIEq2Jw2n0ks4C9w3t1Jz9sAng May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Domain-Id: None May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Domain-Name: None May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Identity-Status: Confirmed May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Is-Admin-Project: True May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Openstack-Nova-Api-Version: 2.90 May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Project-Domain-Id: default May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Project-Domain-Name: Default May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Project-Id: c586cdfef8dc4cea9cf389817d345b08 May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Project-Name: admin May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Role: admin,member,reader May 23 15:22:57.291251 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Roles: admin,member,reader May 23 15:22:57.292784 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c586cdfef8dc4cea9cf389817d345b08", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:22:57.292784 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Tenant: admin May 23 15:22:57.292784 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Tenant-Id: c586cdfef8dc4cea9cf389817d345b08 May 23 15:22:57.292784 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Tenant-Name: admin May 23 15:22:57.292784 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-User: admin May 23 15:22:57.292784 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-User-Domain-Id: default May 23 15:22:57.292784 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-User-Domain-Name: Default May 23 15:22:57.292784 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-User-Id: 61ee072739a04036a34cf038cd44e02b May 23 15:22:57.292784 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-User-Name: admin May 23 15:22:57.292784 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: method: > May 23 15:22:57.292784 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: exception: Flavor 84 could not be found. May 23 15:22:57.292784 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: action_args: {'id': '84'} May 23 15:22:57.292784 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:22:57.292784 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:22:57.294819 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi May 23 15:22:57.296058 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-e545b699-8956-4aea-bd17-9aacd8c07cff admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:22:57.297244 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-e545b699-8956-4aea-bd17-9aacd8c07cff admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062401 May 23 15:22:57.297244 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Mon May 23 15:22:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 15:22:57.302894 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-a79512a8-054c-4564-b350-1df952ec156a admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:57.319129 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-a79512a8-054c-4564-b350-1df952ec156a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019796 May 23 15:22:57.319664 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Mon May 23 15:22:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:22:57.329068 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-3d8ab463-c7d7-4b3a-8bf6-3bcb8678c29f admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:57.342651 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-3d8ab463-c7d7-4b3a-8bf6-3bcb8678c29f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017141 May 23 15:22:57.343157 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Mon May 23 15:22:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:22:57.352679 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-c350a4f1-4254-401e-8b69-e8fc80b6428c admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:57.357955 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.wsgi [None req-c350a4f1-4254-401e-8b69-e8fc80b6428c admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-c350a4f1-4254-401e-8b69-e8fc80b6428c admin admin] Request method failure captured: May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Accept: application/json May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Accept-Encoding: gzip, deflate May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Connection: keep-alive May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Content-Length: 0 May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Host: 10.222.0.30 May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Openstack-Api-Version: compute 2.90 May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Openstack-System-Scope: None May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: User-Agent: python-novaclient May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Auth-Token: gAAAAABii6bRfeJ5R0e6ZYhMfatIde8Rx0qSPpcf1lbZWFICsFbEKY7y7xNP66rjdaiO6eohK3n-ILIvPJZocf4ucUYibRJR1Q9Ulh768QlncNmE0q0oQjxFwNPh79zm2lpfkl8DBCGHEU0_-MSz041wYZJJWQIEq2Jw2n0ks4C9w3t1Jz9sAng May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Domain-Id: None May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Domain-Name: None May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Identity-Status: Confirmed May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Is-Admin-Project: True May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Openstack-Nova-Api-Version: 2.90 May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Project-Domain-Id: default May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Project-Domain-Name: Default May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Project-Id: c586cdfef8dc4cea9cf389817d345b08 May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Project-Name: admin May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Role: admin,member,reader May 23 15:22:57.359439 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Roles: admin,member,reader May 23 15:22:57.361685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c586cdfef8dc4cea9cf389817d345b08", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:22:57.361685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Tenant: admin May 23 15:22:57.361685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Tenant-Id: c586cdfef8dc4cea9cf389817d345b08 May 23 15:22:57.361685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Tenant-Name: admin May 23 15:22:57.361685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-User: admin May 23 15:22:57.361685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-User-Domain-Id: default May 23 15:22:57.361685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-User-Domain-Name: Default May 23 15:22:57.361685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-User-Id: 61ee072739a04036a34cf038cd44e02b May 23 15:22:57.361685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-User-Name: admin May 23 15:22:57.361685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: method: > May 23 15:22:57.361685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: exception: Flavor 84 could not be found. May 23 15:22:57.361685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: action_args: {'id': '84'} May 23 15:22:57.361685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:22:57.361685 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:22:57.362484 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi May 23 15:22:57.363527 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-c350a4f1-4254-401e-8b69-e8fc80b6428c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:22:57.364534 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-c350a4f1-4254-401e-8b69-e8fc80b6428c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011598 May 23 15:22:57.364534 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Mon May 23 15:22:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 15:22:58.229416 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-3d8ab463-c7d7-4b3a-8bf6-3bcb8678c29f admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:58.230407 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-3d8ab463-c7d7-4b3a-8bf6-3bcb8678c29f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 23 15:22:58.230805 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 15:22:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:22:58.422380 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-5345ce91-93a9-4eee-9601-026ca8ba8b70 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:58.428077 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.wsgi [None req-5345ce91-93a9-4eee-9601-026ca8ba8b70 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-5345ce91-93a9-4eee-9601-026ca8ba8b70 admin admin] Request method failure captured: May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Accept: application/json May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Accept-Encoding: gzip, deflate May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Connection: keep-alive May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Content-Length: 0 May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Host: 10.222.0.30 May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Openstack-Api-Version: compute 2.90 May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Openstack-System-Scope: None May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: User-Agent: python-novaclient May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Auth-Token: gAAAAABii6bSggLa1REuJIHpZwh8qZU0zMn-OkaH9YS2vzqKwUvJOKvyEHf1F3WFt4sfVT6xDW6HUdClad-g9OnI4Lic27pIiOVPp-GEaM4uK2VM8W2G5BJjtF7F0j-N8d2DveNyLtvD3vaFxCMp-qTN8DLBkWcn_bB1N6c8UkZMPtgqd6gJfrc May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Domain-Id: None May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Domain-Name: None May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Identity-Status: Confirmed May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Is-Admin-Project: True May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Openstack-Nova-Api-Version: 2.90 May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Project-Domain-Id: default May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Project-Domain-Name: Default May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Project-Id: c586cdfef8dc4cea9cf389817d345b08 May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Project-Name: admin May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Role: admin,member,reader May 23 15:22:58.429632 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Roles: admin,member,reader May 23 15:22:58.431157 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c586cdfef8dc4cea9cf389817d345b08", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:22:58.431157 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Tenant: admin May 23 15:22:58.431157 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Tenant-Id: c586cdfef8dc4cea9cf389817d345b08 May 23 15:22:58.431157 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-Tenant-Name: admin May 23 15:22:58.431157 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-User: admin May 23 15:22:58.431157 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-User-Domain-Id: default May 23 15:22:58.431157 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-User-Domain-Name: Default May 23 15:22:58.431157 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-User-Id: 61ee072739a04036a34cf038cd44e02b May 23 15:22:58.431157 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: X-User-Name: admin May 23 15:22:58.431157 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: method: > May 23 15:22:58.431157 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: exception: Flavor 451 could not be found. May 23 15:22:58.431157 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: action_args: {'id': '451'} May 23 15:22:58.431157 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:22:58.431157 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:22:58.432090 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi May 23 15:22:58.433319 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-5345ce91-93a9-4eee-9601-026ca8ba8b70 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:22:58.434735 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-5345ce91-93a9-4eee-9601-026ca8ba8b70 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061089 May 23 15:22:58.434735 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Mon May 23 15:22:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 15:22:58.441540 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-6e8065bb-6c3a-43e1-bda1-888fcbca6de6 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:58.457569 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-6e8065bb-6c3a-43e1-bda1-888fcbca6de6 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020106 May 23 15:22:58.458113 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Mon May 23 15:22:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:22:58.467812 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-3edd4caa-ed41-4557-915e-51ed8926e9bb admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:58.481285 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-3edd4caa-ed41-4557-915e-51ed8926e9bb admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017028 May 23 15:22:58.481809 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Mon May 23 15:22:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:22:58.491294 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-e62a9b84-27a5-438a-b67b-13b7af68bab8 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:58.496481 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.wsgi [None req-e62a9b84-27a5-438a-b67b-13b7af68bab8 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-e62a9b84-27a5-438a-b67b-13b7af68bab8 admin admin] Request method failure captured: May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Accept: application/json May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Accept-Encoding: gzip, deflate May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Connection: keep-alive May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Content-Length: 0 May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Host: 10.222.0.30 May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Openstack-Api-Version: compute 2.90 May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Openstack-System-Scope: None May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: User-Agent: python-novaclient May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Auth-Token: gAAAAABii6bSggLa1REuJIHpZwh8qZU0zMn-OkaH9YS2vzqKwUvJOKvyEHf1F3WFt4sfVT6xDW6HUdClad-g9OnI4Lic27pIiOVPp-GEaM4uK2VM8W2G5BJjtF7F0j-N8d2DveNyLtvD3vaFxCMp-qTN8DLBkWcn_bB1N6c8UkZMPtgqd6gJfrc May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Domain-Id: None May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Domain-Name: None May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Identity-Status: Confirmed May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Is-Admin-Project: True May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Openstack-Nova-Api-Version: 2.90 May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Project-Domain-Id: default May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Project-Domain-Name: Default May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Project-Id: c586cdfef8dc4cea9cf389817d345b08 May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Project-Name: admin May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Role: admin,member,reader May 23 15:22:58.498002 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Roles: admin,member,reader May 23 15:22:58.499594 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c586cdfef8dc4cea9cf389817d345b08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c586cdfef8dc4cea9cf389817d345b08", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:22:58.499594 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Tenant: admin May 23 15:22:58.499594 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Tenant-Id: c586cdfef8dc4cea9cf389817d345b08 May 23 15:22:58.499594 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-Tenant-Name: admin May 23 15:22:58.499594 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-User: admin May 23 15:22:58.499594 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-User-Domain-Id: default May 23 15:22:58.499594 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-User-Domain-Name: Default May 23 15:22:58.499594 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-User-Id: 61ee072739a04036a34cf038cd44e02b May 23 15:22:58.499594 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: X-User-Name: admin May 23 15:22:58.499594 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: method: > May 23 15:22:58.499594 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: exception: Flavor 451 could not be found. May 23 15:22:58.499594 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: action_args: {'id': '451'} May 23 15:22:58.499594 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:22:58.499594 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:22:58.500558 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi May 23 15:22:58.502323 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-e62a9b84-27a5-438a-b67b-13b7af68bab8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:22:58.503343 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-e62a9b84-27a5-438a-b67b-13b7af68bab8 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011554 May 23 15:22:58.503343 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Mon May 23 15:22:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 15:22:59.381267 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-3edd4caa-ed41-4557-915e-51ed8926e9bb admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:22:59.382280 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-3edd4caa-ed41-4557-915e-51ed8926e9bb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 23 15:22:59.382676 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 15:22:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:22:59.572107 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-daaeff2c-a47a-4ed0-a25b-b1a648877202 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:22:59.589607 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-daaeff2c-a47a-4ed0-a25b-b1a648877202 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069875 May 23 15:22:59.590081 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Mon May 23 15:22:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:23:00.468973 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-3edd4caa-ed41-4557-915e-51ed8926e9bb admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:23:00.469967 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-3edd4caa-ed41-4557-915e-51ed8926e9bb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 23 15:23:00.470888 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 15:23:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:23:00.662378 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-f61c06ad-b32d-4dab-ba2c-aaf272863266 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:23:00.679747 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-f61c06ad-b32d-4dab-ba2c-aaf272863266 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069896 May 23 15:23:00.680272 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Mon May 23 15:23:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:23:01.568326 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-3edd4caa-ed41-4557-915e-51ed8926e9bb admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:23:01.569364 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-3edd4caa-ed41-4557-915e-51ed8926e9bb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 23 15:23:01.569764 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 15:23:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:23:01.783123 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-902de1b8-30ff-402e-a5a6-08e91877d28e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:23:01.803319 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-902de1b8-30ff-402e-a5a6-08e91877d28e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.088587 May 23 15:23:01.804060 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Mon May 23 15:23:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:23:02.673031 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-3edd4caa-ed41-4557-915e-51ed8926e9bb admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:23:02.674784 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-3edd4caa-ed41-4557-915e-51ed8926e9bb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002191 May 23 15:23:02.675184 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 15:23:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:23:02.864214 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-9bf45ea0-ff96-453d-a5c7-a9f2c4277cb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:23:02.881381 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-9bf45ea0-ff96-453d-a5c7-a9f2c4277cb9 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068857 May 23 15:23:02.881908 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Mon May 23 15:23:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:23:03.775354 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-3edd4caa-ed41-4557-915e-51ed8926e9bb admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:23:03.776908 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-3edd4caa-ed41-4557-915e-51ed8926e9bb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 23 15:23:03.777374 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 15:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:23:03.966492 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-cad93334-a3df-46c1-950a-7c5c95c520c3 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:23:03.986620 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-cad93334-a3df-46c1-950a-7c5c95c520c3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071687 May 23 15:23:03.987152 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Mon May 23 15:23:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:24:06.177998 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-3edd4caa-ed41-4557-915e-51ed8926e9bb admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:24:06.179029 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-3edd4caa-ed41-4557-915e-51ed8926e9bb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001982 May 23 15:24:06.179428 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 930 bytes} [Mon May 23 15:24:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:24:06.186775 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:06.237856 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-0de0016e-5bcf-4c2a-bebc-31528f2edac7 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:24:06.262795 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-0de0016e-5bcf-4c2a-bebc-31528f2edac7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077416 May 23 15:24:06.263347 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1291 bytes} [Mon May 23 15:24:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:24:06.284006 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=14 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:06.288505 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-5b33cf93-d9c5-4a9f-bc82-f51ce65fe866 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:24:06.296224 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-5b33cf93-d9c5-4a9f-bc82-f51ce65fe866 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013658 May 23 15:24:06.296742 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1282 bytes} [Mon May 23 15:24:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:24:06.308776 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-5dfb1f8e-969d-4dbe-8860-a2a310d57f38 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:24:06.316339 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-5dfb1f8e-969d-4dbe-8860-a2a310d57f38 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011174 May 23 15:24:06.316846 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1285 bytes} [Mon May 23 15:24:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:24:06.327669 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-c99d4c0d-e202-4804-afe0-bc8f6303a502 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:24:06.335095 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-c99d4c0d-e202-4804-afe0-bc8f6303a502 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010889 May 23 15:24:06.335597 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1285 bytes} [Mon May 23 15:24:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:24:06.347601 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-20c3a473-98db-44f7-b40b-adfe37a2829f admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:24:06.355670 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-20c3a473-98db-44f7-b40b-adfe37a2829f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011551 May 23 15:24:06.356178 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1282 bytes} [Mon May 23 15:24:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:27:40.554514 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-c99d4c0d-e202-4804-afe0-bc8f6303a502 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:27:40.555529 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-c99d4c0d-e202-4804-afe0-bc8f6303a502 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 23 15:27:40.555928 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 15:27:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:27:40.715059 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writing DB stats nova_api:SELECT=6 {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:40.827817 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-e4bbae74-c030-4a49-bb2e-8768bb809a1b admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:27:40.829018 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:27:40.829018 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: warnings.warn(msg) May 23 15:27:40.830218 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-e4bbae74-c030-4a49-bb2e-8768bb809a1b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:27:40.830657 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-e4bbae74-c030-4a49-bb2e-8768bb809a1b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:27:40.831447 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-e4bbae74-c030-4a49-bb2e-8768bb809a1b admin admin] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:27:40.831873 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-e4bbae74-c030-4a49-bb2e-8768bb809a1b admin admin] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:27:40.865836 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-e4bbae74-c030-4a49-bb2e-8768bb809a1b admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152105 May 23 15:27:40.866384 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Mon May 23 15:27:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:27:41.761765 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-c99d4c0d-e202-4804-afe0-bc8f6303a502 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:27:41.762775 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-c99d4c0d-e202-4804-afe0-bc8f6303a502 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 23 15:27:41.763168 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 15:27:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:27:41.952799 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-a7daf8c7-40ef-47cd-966c-33db2c89fc4a admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:27:41.953982 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:27:41.953982 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: warnings.warn(msg) May 23 15:27:41.955142 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-a7daf8c7-40ef-47cd-966c-33db2c89fc4a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:27:41.955578 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-a7daf8c7-40ef-47cd-966c-33db2c89fc4a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:27:41.956353 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-a7daf8c7-40ef-47cd-966c-33db2c89fc4a admin admin] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:27:41.956778 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-a7daf8c7-40ef-47cd-966c-33db2c89fc4a admin admin] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:27:41.977120 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-a7daf8c7-40ef-47cd-966c-33db2c89fc4a admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075566 May 23 15:27:41.977657 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Mon May 23 15:27:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:27:53.242111 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-c99d4c0d-e202-4804-afe0-bc8f6303a502 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:27:53.243122 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-c99d4c0d-e202-4804-afe0-bc8f6303a502 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 May 23 15:27:53.243519 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 36/73] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 15:27:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:27:53.384803 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writing DB stats nova_cell0:SELECT=4 {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:53.385537 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writing DB stats nova_cell1:SELECT=4 {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:53.386218 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writing DB stats nova_api:SELECT=8 {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:27:53.435215 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-8e93d784-1180-4ed4-85ba-d453e4df7d3d admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:27:53.436393 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:27:53.436393 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: warnings.warn(msg) May 23 15:27:53.437609 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-8e93d784-1180-4ed4-85ba-d453e4df7d3d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:27:53.438054 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-8e93d784-1180-4ed4-85ba-d453e4df7d3d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:27:53.438845 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-8e93d784-1180-4ed4-85ba-d453e4df7d3d admin admin] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:27:53.439302 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-8e93d784-1180-4ed4-85ba-d453e4df7d3d admin admin] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:27:53.464461 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-8e93d784-1180-4ed4-85ba-d453e4df7d3d admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084211 May 23 15:27:53.464966 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 38/74] 10.222.0.30 () {60 vars in 1193 bytes} [Mon May 23 15:27:53 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:27:54.398884 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-c99d4c0d-e202-4804-afe0-bc8f6303a502 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:27:54.399897 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-c99d4c0d-e202-4804-afe0-bc8f6303a502 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 23 15:27:54.400293 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 37/75] 10.222.0.30 () {56 vars in 1074 bytes} [Mon May 23 15:27:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:27:54.591634 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-c70aec83-2269-444e-b064-88c59e846845 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:27:54.592814 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:27:54.592814 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: warnings.warn(msg) May 23 15:27:54.594088 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-c70aec83-2269-444e-b064-88c59e846845 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:27:54.594596 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-c70aec83-2269-444e-b064-88c59e846845 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:27:54.595481 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-c70aec83-2269-444e-b064-88c59e846845 admin admin] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:27:54.595973 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-c70aec83-2269-444e-b064-88c59e846845 admin admin] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:27:54.618286 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-c70aec83-2269-444e-b064-88c59e846845 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078910 May 23 15:27:54.618907 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 39/76] 10.222.0.30 () {60 vars in 1193 bytes} [Mon May 23 15:27:54 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:28:55.736821 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: Mon May 23 15:28:55 2022 - graceful shutdown triggered... May 23 15:28:55.736304 dv-cinder-841125-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 23 15:28:55.737861 dv-cinder-841125-8-iscsi devstack@n-api.service[103339]: Gracefully killing worker 1 (pid: 103339)... May 23 15:28:55.738237 dv-cinder-841125-8-iscsi devstack@n-api.service[103340]: Gracefully killing worker 2 (pid: 103340)... May 23 15:28:56.737078 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: worker 1 buried after 1 seconds May 23 15:28:56.737551 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: worker 2 buried after 1 seconds May 23 15:28:56.737551 dv-cinder-841125-8-iscsi devstack@n-api.service[103338]: goodbye to uWSGI. May 23 15:28:56.738617 dv-cinder-841125-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 23 15:28:56.739226 dv-cinder-841125-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 23 15:28:56.742035 dv-cinder-841125-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 15:28:56.756326 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 15:28:56.775805 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 15:28:56 2022] *** May 23 15:28:56.775805 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 15:28:56.775805 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 15:28:56.775805 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: nodename: dv-cinder-841125-8-iscsi May 23 15:28:56.775805 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: machine: x86_64 May 23 15:28:56.775805 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: clock source: unix May 23 15:28:56.775805 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: pcre jit disabled May 23 15:28:56.775805 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: detected number of CPU cores: 4 May 23 15:28:56.775805 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: current working directory: / May 23 15:28:56.775805 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: detected binary path: /usr/bin/uwsgi-core May 23 15:28:56.775805 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: your processes number limit is 47680 May 23 15:28:56.775805 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: your memory page size is 4096 bytes May 23 15:28:56.775805 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: detected max file descriptor number: 2048 May 23 15:28:56.776914 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: lock engine: pthread robust mutexes May 23 15:28:56.776914 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: thunder lock: enabled May 23 15:28:56.776914 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 15:28:56.776914 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 15:28:56.827071 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: Python main interpreter initialized at 0x5593819259c0 May 23 15:28:56.827071 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: python threads support enabled May 23 15:28:56.827071 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: your server socket listen backlog is limited to 100 connections May 23 15:28:56.827071 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: your mercy for graceful operations on workers is 90 seconds May 23 15:28:56.827509 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: mapped 403077 bytes (393 KB) for 2 cores May 23 15:28:56.827595 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: *** Operational MODE: preforking *** May 23 15:28:56.827812 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: *** uWSGI is running in multiple interpreter mode *** May 23 15:28:56.827812 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: spawned uWSGI master process (pid: 117957) May 23 15:28:56.828023 dv-cinder-841125-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 15:28:56.830933 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: spawned uWSGI worker 1 (pid: 117973, cores: 1) May 23 15:28:56.830933 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: spawned uWSGI worker 2 (pid: 117974, cores: 1) May 23 15:28:56.830933 dv-cinder-841125-8-iscsi devstack@n-api.service[117957]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 15:28:58.027191 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 15:28:58.040431 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 15:28:58.829500 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:28:58.829500 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: from cryptography.utils import int_from_bytes May 23 15:28:58.829844 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:28:58.829844 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: from cryptography.utils import int_from_bytes May 23 15:28:58.832171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:28:58.832171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: from cryptography.utils import int_from_bytes May 23 15:28:58.832511 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:28:58.832511 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: from cryptography.utils import int_from_bytes May 23 15:29:01.282927 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 15:29:01.283616 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 15:29:01.283709 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 15:29:01.284110 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 15:29:01.284319 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 15:29:01.284727 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.285081 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.285467 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.285793 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.286190 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.286507 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.286875 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.287211 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.287548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.287815 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.288133 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.288461 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841125-8-iscsi {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.288787 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.289218 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.289601 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.289928 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.290239 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.290622 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.290996 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.291515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.291967 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.292284 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.292602 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.292969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.293369 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.294081 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.294416 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.294849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.295246 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.295633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.296119 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841125-8-iscsi {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.296470 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.297633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.297972 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.298469 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.298775 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.299094 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.299422 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.299752 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.300068 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.300402 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.300728 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.301078 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.301404 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.301714 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.302029 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.302343 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.302667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.302979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.303289 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.303543 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.303854 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.304180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.304504 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.304841 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.305115 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.305368 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.305689 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.306014 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.306333 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.306647 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.306957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.307269 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.307577 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.307885 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.308193 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.308504 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.308825 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.309168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.309495 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.309806 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.310128 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.310532 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.310786 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.311099 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.311441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.311762 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.312075 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.312397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.313430 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.313755 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.314066 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.314381 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.314709 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.315042 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.315354 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.315607 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.315955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.316282 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.316654 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.317000 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.317329 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.317640 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.317947 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.318259 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.318569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.318880 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.319189 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.319499 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.319809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.320123 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.320430 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.320980 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.321311 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.321633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.322115 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.322432 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.322747 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.323063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.323391 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.323705 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.324018 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.324345 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.324656 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.324990 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.325496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.325815 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.326133 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.326479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.326795 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.327257 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.327607 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.327924 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.328263 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.328574 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.328917 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.329283 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.329592 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.329902 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.330211 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.330516 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.330839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.331165 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.331479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.331792 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.332101 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.332422 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.332790 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.333153 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.333504 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.333850 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.334189 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.334527 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.334853 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.335172 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.335492 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.335822 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.336176 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.336455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.336773 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.337123 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.337452 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.337789 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.338111 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.338432 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.338756 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.339072 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.339396 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.339729 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.340058 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.340375 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.340719 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.341094 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.341413 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.341741 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.342070 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.342384 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.342698 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.343013 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.343328 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 15:29:01.344311 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.344443 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 15:29:01.344534 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.344719 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.344825 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 15:29:01.345117 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 15:29:01.345265 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.345391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 15:29:01.345548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.345767 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.345902 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.346102 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.346229 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.346500 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.346827 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.347151 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.347346 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.347580 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.347732 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.347885 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.348039 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.348198 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.348351 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.348496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.348639 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.348782 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.349004 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.349172 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.349327 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.349474 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.353008 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.353109 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.353196 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.353288 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.353364 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841125-8-iscsi {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.353436 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.353505 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.353575 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.353654 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.353789 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.353871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.353950 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.354022 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.354100 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.354185 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.354257 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.354326 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.354402 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.354482 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.354561 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.354561 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.354706 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.354800 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.354883 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.354955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.355037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.355117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.355197 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.355276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.355353 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.355431 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.355514 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.355587 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.355667 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.355762 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.355840 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.355922 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.356002 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.356073 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.356142 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.356218 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.356290 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.356366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.356449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841125-8-iscsi {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.356529 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.356692 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.356785 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.357024 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.357132 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.357340 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.357423 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.357658 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.357758 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.357972 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.358062 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.358300 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.358390 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.358620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.358710 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.358937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.359020 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.359284 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.360073 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.360373 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.360620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.360723 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.360812 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.360908 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.361899 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.362058 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.362330 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.362597 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.362776 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.363522 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.363691 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.363848 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.364002 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.364146 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.364288 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.364429 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.364569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.364717 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.364949 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.365128 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.365284 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.365426 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.365567 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.365714 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.365866 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.366009 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.366162 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.366316 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.366463 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.366613 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.366765 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.366917 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.367079 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.367311 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.367464 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.367614 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.367844 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.367993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.368143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.368286 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.368441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.368584 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.368725 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.368897 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.369061 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.369216 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.369216 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.369502 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.369659 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.369809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.369957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.370107 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.370255 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.370619 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.370779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.370929 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.371088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.371239 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.371389 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.371546 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.371696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.371855 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.371855 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.372209 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.372209 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.372620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.372861 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.373061 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.373213 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.373374 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.373528 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.373681 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.373830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.373980 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.374129 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.374279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.374435 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.374578 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.374726 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.374875 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.375061 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.375354 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.375519 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.375673 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.375815 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.375964 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.376106 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.376255 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.376405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.376546 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.376699 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.376842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.377007 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.377162 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.377347 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.377569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.377725 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.377896 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.378108 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.378256 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.378406 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.378555 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.378705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.379242 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.379406 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.379564 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.379717 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.379891 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.381197 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.381372 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.381525 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.381753 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.381900 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.382060 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.382275 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.382423 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.382588 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.382848 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.383083 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.383239 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.383400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.383558 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.383706 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.383859 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.384003 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.384145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.384286 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.384427 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.384627 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.384787 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.385667 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.385878 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.386048 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.386215 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.386368 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.386789 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.386932 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.387240 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.387414 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.387579 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.387800 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.387956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.388131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.388361 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.388516 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.388668 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.388833 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.389003 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.389147 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.389303 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.389446 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.389587 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.389734 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.390185 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.390352 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.390506 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.390681 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.391035 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.391198 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.391342 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.391494 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.391637 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.391788 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.391932 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.392072 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.392213 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.392454 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.392612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.392756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.393031 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.393193 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.393358 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.393519 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.393686 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.393918 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.394067 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.394209 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.394350 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.394501 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.394652 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.394802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.394952 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.395095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.395250 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.395403 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.395545 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.395695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.395838 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.395987 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.396142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.396286 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:29:01.396428 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.396579 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.396720 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.396902 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.397077 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.397221 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.397374 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.397662 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.397839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.398060 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.398553 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.398708 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.398851 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.398992 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.399142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.399292 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.399435 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.399584 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.399778 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.399928 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.400071 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.400221 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.400395 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.400538 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.400688 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.400831 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.401375 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.401616 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.401768 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.401881 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.401998 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.402108 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.402228 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.402347 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.402483 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.402979 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.403244 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.403410 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.403605 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.403791 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.403956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.404261 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.404407 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.404557 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.404721 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.404894 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.405057 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.405201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.405349 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.406899 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.407166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.407378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.407539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.407684 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.408269 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.408442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.408687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.408839 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.409058 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.409215 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.409365 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.409515 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.409657 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.409805 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.409948 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.409948 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.410228 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.410369 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.410517 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.410679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.410835 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.410991 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.411296 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.411535 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.411695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.411839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.411994 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.412145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.412296 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.412445 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.412594 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.412736 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.412939 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.413164 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.413447 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.413597 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.413747 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.413889 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.414046 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.414292 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.414453 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.414661 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.414812 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.414997 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.415240 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.415388 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.415388 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.415674 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.416148 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.416315 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.416315 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.416606 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.416757 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.416954 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.417113 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.417265 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.417416 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.417570 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.417721 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.418185 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.418413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.418578 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.418813 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.418964 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.419107 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.419249 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.419397 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.419549 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.419700 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.419843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.420002 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.420145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.420300 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.420450 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.420593 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.420744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.420915 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.421076 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.421249 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.421558 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.421769 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.422058 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.422213 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.422877 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.422877 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.423185 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.423424 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.423669 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.423822 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.423971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.424123 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.424292 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.424523 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.424679 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.424824 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.425012 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.425166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.425319 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.425471 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.425620 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.425771 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.425923 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.426066 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.426206 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.426348 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.426489 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.426639 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.426789 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.426945 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.427094 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.427244 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.427392 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.427560 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.428144 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.428305 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.428554 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.428706 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.429057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.429224 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.429369 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.429511 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.429665 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.431155 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.431328 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.431643 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.431819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.432034 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.432191 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.432353 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.432680 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.432893 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.433183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.433345 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.433550 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.433818 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.433978 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.434132 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.434285 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.434429 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.434584 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.434728 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.434990 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.435141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.435293 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.435438 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.435588 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.435730 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.435896 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.436040 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.436040 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.436318 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.436487 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.436777 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.436978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.437137 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.437288 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.437458 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.437626 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.437875 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.438159 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.438333 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.438480 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.438747 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.438940 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.439176 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.439327 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.439478 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.439630 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.439781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.439930 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.440082 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.440225 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.440386 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.440530 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.440679 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.441199 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.441373 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.441518 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.441848 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.442019 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.442240 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.442404 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.442556 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.442708 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.442861 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.443025 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.443186 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.443421 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.443573 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.443725 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.444000 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.444171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.444321 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.444484 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.444643 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.444800 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.445137 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.445304 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.445472 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.445677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.445677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.446301 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.446460 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.446609 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.446757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.446915 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.447065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.447221 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.447378 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.447535 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.447693 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.447860 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.448020 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.448169 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.448317 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.448465 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.448678 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.448955 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.449143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.449377 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.449541 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.449701 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.449860 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.450022 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.450179 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.450336 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.450492 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.450648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.450810 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.450983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.451697 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.452031 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.452194 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.452446 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.452603 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.452752 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.452988 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.453259 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.453623 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.453797 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.453950 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.454108 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.454259 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.454408 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.454564 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.454812 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.455059 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.455331 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.455497 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.455667 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.455817 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.455975 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.456125 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.456274 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.456429 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.456586 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.456746 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.456923 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.457086 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.457246 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.457399 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.457548 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.457715 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.458209 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.458383 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.458534 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.458691 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.458848 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.459114 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.459272 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.459549 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.459714 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.460170 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.460329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.460503 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.460661 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.460819 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.460993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.461145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.461312 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.461464 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.461620 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.461780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.461956 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.462264 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.462446 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.462680 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.462847 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.463005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.463163 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.463321 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.463579 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.463804 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.463967 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.464125 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.464523 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.464694 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.464858 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.465076 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.465346 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.465603 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.465764 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.465924 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.466083 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.466234 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.466382 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.466531 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.466687 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.466846 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.467003 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.467153 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.467301 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.467301 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.467609 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.467769 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.467920 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.468076 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.468233 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.468382 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.468538 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.468538 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.470290 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.470290 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.470601 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.470601 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.470906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.471066 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.471215 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.471365 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.471521 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.471679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.471837 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.471987 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.472315 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.472315 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.472623 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.472927 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.473103 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.473103 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.473408 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.473408 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.473692 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.473941 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.474120 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.474284 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.474442 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.474442 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.474739 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.474903 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.475053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.475210 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.475486 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.475761 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.475920 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.476079 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.476230 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.476388 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.476537 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.476685 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.476833 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.477035 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.477187 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.477338 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.477496 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.477646 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.477808 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.477958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.477958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.478667 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.478844 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.478998 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.479147 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.479304 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.479456 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.479613 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.479950 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.480128 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.480287 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.480446 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.480604 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.480754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.480950 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.481108 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.481266 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.481422 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.481573 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.481730 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.481730 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.482063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.482230 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.482534 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.482701 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.482880 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.483099 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.483257 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.483407 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.483564 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.483715 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.483877 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.484116 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.484428 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.485203 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.485456 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.485723 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.486103 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.486283 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.486437 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.486595 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.486746 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.486910 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.487204 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.487384 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.487544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.487701 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.488206 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.488382 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.488535 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.488535 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.488829 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.488829 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.489246 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.489411 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.489561 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.489710 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.489879 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.490231 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.490389 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.490565 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.490725 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.490884 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.491040 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.491190 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.491349 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.491510 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.491660 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.491815 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.491966 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.491966 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.492258 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.492416 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.492734 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.492929 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.493107 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.493328 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.493496 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.493654 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.493811 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.494039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.494291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.494450 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.494613 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.494764 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.494912 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.495080 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.495230 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.495388 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.495538 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.495712 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.495962 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.496231 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.496399 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.496564 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.496714 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.496915 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.497084 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.497249 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.497413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.497642 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.497801 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.497959 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.498107 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.498107 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.498446 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.498606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.498756 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.498905 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.499060 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.499210 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.499384 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.499549 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.499699 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.499855 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.500051 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.500366 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.500529 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.500686 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.500844 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.501027 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.501187 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.501345 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.501505 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.501665 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.501824 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.501980 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.502130 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.502277 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.502438 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.502595 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.502912 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.503084 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.503243 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.503493 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.503493 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.503788 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.503966 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.505161 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.505363 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.505523 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.505677 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.505836 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.505996 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.506178 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.506536 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.506700 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.506850 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.507008 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.507169 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.507333 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.507484 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.507641 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.507793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.507942 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.508092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.508250 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.508408 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.508566 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.508725 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.508914 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.509085 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.509256 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.509415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.509565 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.509724 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.509883 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.510041 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.510218 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.510529 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.510681 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.510831 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.510987 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.511150 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.511322 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.511739 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.511898 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.512049 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.512207 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.512357 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.512505 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.512660 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.513024 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.513190 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.513354 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.513586 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.513755 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.514310 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.514605 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.514776 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.514937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.515125 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.515280 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.515430 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.515605 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.515810 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.516080 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.516288 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.516653 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.516827 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.517042 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.517214 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.517375 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.517525 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.517674 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.518144 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.518316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.518477 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.518628 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.518785 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.518936 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.519095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.519095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.519418 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.519568 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.519717 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.519865 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.520021 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.520172 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.520330 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.520655 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.520822 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.520996 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.521165 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.521337 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.521495 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.521645 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.521794 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.521942 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.522097 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.522256 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.522415 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.522571 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.522729 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.522886 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.523196 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.523445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.523632 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.523862 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.524026 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.524181 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.524340 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.524510 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.524759 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.524944 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.525103 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.525252 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.525416 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.525575 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.525575 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.525575 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.525575 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.525575 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.526315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.526473 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.526827 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.526995 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.527146 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.527302 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.527462 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.527622 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.527771 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.527931 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.528081 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.528237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.528397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.528547 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.528698 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.529249 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.529424 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.529585 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.529738 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.529887 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.530045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.530195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.530359 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.530517 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.530833 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.530991 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.531141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.531821 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.531974 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.532133 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.532282 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.532444 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.532602 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.532752 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.532921 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.533107 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.533419 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.533577 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.533735 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.533979 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.534155 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.534307 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.534465 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.534614 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.534788 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.535008 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.535178 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.535178 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.535474 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.535631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.535781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.535930 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.536093 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.536243 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.536393 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.536542 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.536690 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.537219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.537396 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.537557 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.537719 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.537869 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.538018 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.538177 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.538335 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.538492 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.538642 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.538801 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.538951 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.539108 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.539259 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.539409 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.539557 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.539718 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.539875 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.540033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.540194 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.540344 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.540491 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.540638 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.541257 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.541445 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.541603 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.541760 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.541911 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.542062 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.542230 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.542383 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.542532 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.542680 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.542836 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.542836 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.543136 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.543287 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.543590 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.543755 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.543905 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.544150 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.544329 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.544481 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.544639 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.544790 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.544982 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.545204 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.545376 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.545534 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.545684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.545840 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.545990 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.546153 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.546303 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.546464 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.546613 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.546797 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.547071 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.547448 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.547658 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.547658 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.548540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.548709 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.548890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.549060 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.549231 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.549395 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.550111 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.550285 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.550437 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.550595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.550747 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.551396 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.551561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.551714 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.551872 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.552031 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.552189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.552363 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.552514 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.552671 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.552831 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.553008 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.553178 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.553178 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.553483 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.553829 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.553982 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.554164 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.554407 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.554573 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.554725 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.554725 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.555009 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.555158 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.555416 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.555580 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.555738 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.555889 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.556041 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.556204 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.556353 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.556510 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.556678 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.556678 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.557031 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.557274 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.557675 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.557834 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.557985 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.558142 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.558299 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.558459 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.558617 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.558767 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.559271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.559442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.559652 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.559813 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.559963 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.560120 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.560278 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.560278 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.560572 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.560572 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.561330 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.561499 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.561650 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.561823 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.561983 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.562133 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.563810 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.563980 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.564141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.564291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.564564 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.564733 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.564913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.565082 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.565233 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.565424 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.565667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.565830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.565980 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.565980 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.566272 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.566431 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.566588 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.566737 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.566885 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.567033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.567188 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.567346 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.567507 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.567865 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.568025 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.568190 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.568340 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.568498 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.568648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.568796 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.569062 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.569214 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.569375 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.569535 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.569692 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.569852 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.570001 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.570149 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.570305 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.570454 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.570611 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.570768 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.570917 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.571064 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.571225 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.571532 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.571700 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.571850 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.571850 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.572153 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.572314 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.572464 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.572619 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.572619 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.572930 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.573104 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.573262 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.573413 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.573562 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.573718 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.573967 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.574134 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.574293 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.574443 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.574678 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.574838 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.574994 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.575159 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.575316 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.575474 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.575640 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.575859 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.576016 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.576186 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.576337 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.576494 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.576651 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.576809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.577005 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.577126 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.577228 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.577327 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.577416 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.577511 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.577609 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.577715 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.577802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.577883 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.577964 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.578085 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.578195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.578271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.578414 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.578550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.578643 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.578740 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.578833 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.578920 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.579004 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.579088 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.579171 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.579264 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.579358 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.579453 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.579539 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.579638 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.579737 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.579824 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.579908 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.579994 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.580085 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.580179 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.580277 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.580364 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.580364 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.580534 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.580627 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.580713 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.580811 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.580942 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.581033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.581121 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.581212 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.581319 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.581406 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.581489 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.581570 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.581649 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.581721 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.581721 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.581891 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.581976 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.582060 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.582143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.582234 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.582327 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.582421 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.582508 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.582591 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.582674 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.582757 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.582849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 15:29:01.582943 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.582943 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.582943 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.582943 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.582943 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.582943 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.582943 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.582943 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.583543 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.583543 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.583543 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.583543 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.583543 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.583543 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.583543 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.583543 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.584370 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.584370 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.584370 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.584370 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.584370 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.584370 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.584370 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.584370 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.585496 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.585496 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.585496 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.585496 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.585496 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.585496 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.585496 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.585496 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.586332 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.586332 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.586332 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.586332 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.586332 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.586332 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.586332 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.586332 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.587161 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.587161 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.587161 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.587161 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.587161 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.587161 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.587161 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.587161 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.588005 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.588005 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.588005 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.588005 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.588005 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.588005 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.588005 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.588005 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.588847 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.588847 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.588847 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.588847 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.588847 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.588847 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.588847 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.588847 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.589722 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.589722 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.589722 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.589722 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.589722 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.589722 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.589722 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.589722 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.590547 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.590547 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.590547 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.590547 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.590547 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.590547 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.590547 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.590547 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.591388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.591388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.591388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.591388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.591388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.591388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.591388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.591388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.592220 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.592220 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.592220 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.592220 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.592220 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.592220 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.592220 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.592220 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.593091 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.593091 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.593091 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.593091 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.593091 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.593091 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.593091 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.593091 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.594690 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.594690 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.594690 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.594690 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.594690 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.594690 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.594690 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.594690 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.595292 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.595292 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.595292 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.595292 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.595292 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.595292 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.595292 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.595292 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.595811 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.595811 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.595811 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.595811 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.595811 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.595811 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.595811 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.595811 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.596324 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.596324 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.596324 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.596324 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.596324 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.596324 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.596324 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.596324 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.597240 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.597240 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.597240 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.597517 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.597794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.598277 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.598447 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.598756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.599102 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.599420 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.599745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.600066 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.600386 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.600706 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.601052 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.601394 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.601730 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.602047 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.602381 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.602707 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.603039 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.603364 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.603688 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.604026 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.604448 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.604798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.605155 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.605478 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.605802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.606128 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.606455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.606792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.607128 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.607449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.607786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.608121 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.608481 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.608807 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.609737 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.609737 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.610177 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.610508 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.610829 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:29:01.611083 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 15:29:01.615410 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO dbcounter [None req-dd9f7ccb-3c15-46d6-918c-38497a906374 None None] Registered counter for database nova_api May 23 15:29:01.636047 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_db.sqlalchemy.engines [None req-dd9f7ccb-3c15-46d6-918c-38497a906374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:29:01.645144 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writer thread running {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:29:01.672920 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO dbcounter [None req-f559ece3-6042-40e0-8b09-4fd9f62efbb9 None None] Registered counter for database nova_api May 23 15:29:01.692793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_db.sqlalchemy.engines [None req-f559ece3-6042-40e0-8b09-4fd9f62efbb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117973) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:29:01.700115 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writer thread running {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:29:01.704314 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.context [None req-dd9f7ccb-3c15-46d6-918c-38497a906374 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f40d0327-0eaf-46c7-bb5c-33377a3083ec(cell1) {{(pid=117974) load_cells /opt/stack/nova/nova/context.py:464}} May 23 15:29:01.708953 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-dd9f7ccb-3c15-46d6-918c-38497a906374 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:29:01.710635 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-dd9f7ccb-3c15-46d6-918c-38497a906374 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:29:01.711527 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-dd9f7ccb-3c15-46d6-918c-38497a906374 None None] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:29:01.713763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-dd9f7ccb-3c15-46d6-918c-38497a906374 None None] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:29:01.715892 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO dbcounter [None req-dd9f7ccb-3c15-46d6-918c-38497a906374 None None] Registered counter for database nova_cell0 May 23 15:29:01.720497 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO dbcounter [None req-dd9f7ccb-3c15-46d6-918c-38497a906374 None None] Registered counter for database nova_cell1 May 23 15:29:01.728359 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_db.sqlalchemy.engines [None req-dd9f7ccb-3c15-46d6-918c-38497a906374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:29:01.730630 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_db.sqlalchemy.engines [None req-dd9f7ccb-3c15-46d6-918c-38497a906374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:29:01.738938 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writer thread running {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:29:01.740312 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writer thread running {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:29:01.757140 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.context [None req-f559ece3-6042-40e0-8b09-4fd9f62efbb9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f40d0327-0eaf-46c7-bb5c-33377a3083ec(cell1) {{(pid=117973) load_cells /opt/stack/nova/nova/context.py:464}} May 23 15:29:01.761285 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f559ece3-6042-40e0-8b09-4fd9f62efbb9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:29:01.763119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f559ece3-6042-40e0-8b09-4fd9f62efbb9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:29:01.763933 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f559ece3-6042-40e0-8b09-4fd9f62efbb9 None None] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:29:01.766057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f559ece3-6042-40e0-8b09-4fd9f62efbb9 None None] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:29:01.768045 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO dbcounter [None req-f559ece3-6042-40e0-8b09-4fd9f62efbb9 None None] Registered counter for database nova_cell0 May 23 15:29:01.772428 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO dbcounter [None req-f559ece3-6042-40e0-8b09-4fd9f62efbb9 None None] Registered counter for database nova_cell1 May 23 15:29:01.779471 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_db.sqlalchemy.engines [None req-f559ece3-6042-40e0-8b09-4fd9f62efbb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117973) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:29:01.782157 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_db.sqlalchemy.engines [None req-f559ece3-6042-40e0-8b09-4fd9f62efbb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117973) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:29:01.787190 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writer thread running {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:29:01.792437 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writer thread running {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:29:01.906573 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO dbcounter [None req-dd9f7ccb-3c15-46d6-918c-38497a906374 None None] Registered counter for database nova_cell0 May 23 15:29:01.914077 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_db.sqlalchemy.engines [None req-dd9f7ccb-3c15-46d6-918c-38497a906374 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:29:01.918597 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writer thread running {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:29:01.937170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO dbcounter [None req-f559ece3-6042-40e0-8b09-4fd9f62efbb9 None None] Registered counter for database nova_cell0 May 23 15:29:01.944481 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_db.sqlalchemy.engines [None req-f559ece3-6042-40e0-8b09-4fd9f62efbb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117973) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:29:01.948845 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writer thread running {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:29:02.254224 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: WARNING keystonemiddleware.auth_token [None req-dd9f7ccb-3c15-46d6-918c-38497a906374 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 15:29:02.261815 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: WARNING keystonemiddleware.auth_token [None req-dd9f7ccb-3c15-46d6-918c-38497a906374 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 15:29:02.269248 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: WARNING keystonemiddleware.auth_token [None req-f559ece3-6042-40e0-8b09-4fd9f62efbb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 15:29:02.276972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: WARNING keystonemiddleware.auth_token [None req-f559ece3-6042-40e0-8b09-4fd9f62efbb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 15:29:02.612294 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: WARNING keystonemiddleware.auth_token [None req-dd9f7ccb-3c15-46d6-918c-38497a906374 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 15:29:02.618347 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: WARNING keystonemiddleware.auth_token [None req-dd9f7ccb-3c15-46d6-918c-38497a906374 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 15:29:02.623860 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5593819259c0 pid: 117974 (default app) May 23 15:29:02.624363 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: WARNING keystonemiddleware.auth_token [None req-f559ece3-6042-40e0-8b09-4fd9f62efbb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 15:29:02.631062 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: WARNING keystonemiddleware.auth_token [None req-f559ece3-6042-40e0-8b09-4fd9f62efbb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 15:29:02.636620 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5593819259c0 pid: 117973 (default app) May 23 15:29:45.106420 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=3 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:45.107759 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=3 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:45.108799 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=3 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:45.109557 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=3 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:45.757457 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5ca6cd6f-50f8-4608-9b12-ac17f827918b tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Action: 'create', calling method: .version_select at 0x7f0d7c470ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1820312659", "metadata": {"Type": "work"}}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5ca6cd6f-50f8-4608-9b12-ac17f827918b tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Request method failure captured: May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 122 May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6hoTPnDEA4A50ZZP1sDVqnEkLaDv7wxUrZLjvgIyYyQ0EWQQu7gaZyy293_gNaKlMjN2HVEyuTBoVxs5derIy2-nxsoMWlF9AA0zTsckXkOb0MxG5Yw4TUzqVQLSdPQDB_JYy_AHp2xbWt7Dylglgrizpd1XSZenKKMOAt67uU1GcU May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: da1811a65421483f9fed0285deca97a2 May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-VolumesNegativeTest-1514237778 May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:29:45.797955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:29:45.799408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/da1811a65421483f9fed0285deca97a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da1811a65421483f9fed0285deca97a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da1811a65421483f9fed0285deca97a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_da1811a65421483f9fed0285deca97a2", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:29:45.799408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-VolumesNegativeTest-1514237778 May 23 15:29:45.799408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: da1811a65421483f9fed0285deca97a2 May 23 15:29:45.799408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-VolumesNegativeTest-1514237778 May 23 15:29:45.799408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-VolumesNegativeTest-1514237778-project May 23 15:29:45.799408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:29:45.799408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:29:45.799408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: bd79f566bbcd4725b358eea50996447a May 23 15:29:45.799408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-VolumesNegativeTest-1514237778-project May 23 15:29:45.799408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: May 23 15:29:45.799408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1820312659", "metadata": {"Type": "work"}}} May 23 15:29:45.799408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: May 23 15:29:45.799408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1820312659', 'metadata': {'Type': 'work'}}}} May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise error May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi '#$%' May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:29:45.800290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 15:29:45.802780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 15:29:45.806084 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 15:29:45.806084 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:45.809334 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5ca6cd6f-50f8-4608-9b12-ac17f827918b tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:29:45.812988 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5ca6cd6f-50f8-4608-9b12-ac17f827918b tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.711939 May 23 15:29:45.822072 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1155 bytes} [Mon May 23 15:29:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 723 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 15:29:46.192376 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1323f295-a123-4625-ab19-dde1d29a6bb2 tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Action: 'create', calling method: .version_select at 0x7f0d7cdfc280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1720801736", "metadata": {"Type": "work"}}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1323f295-a123-4625-ab19-dde1d29a6bb2 tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Request method failure captured: May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 120 May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6hoTPnDEA4A50ZZP1sDVqnEkLaDv7wxUrZLjvgIyYyQ0EWQQu7gaZyy293_gNaKlMjN2HVEyuTBoVxs5derIy2-nxsoMWlF9AA0zTsckXkOb0MxG5Yw4TUzqVQLSdPQDB_JYy_AHp2xbWt7Dylglgrizpd1XSZenKKMOAt67uU1GcU May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: da1811a65421483f9fed0285deca97a2 May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-VolumesNegativeTest-1514237778 May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:29:46.202623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:29:46.203906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/da1811a65421483f9fed0285deca97a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da1811a65421483f9fed0285deca97a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da1811a65421483f9fed0285deca97a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_da1811a65421483f9fed0285deca97a2", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:29:46.203906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-VolumesNegativeTest-1514237778 May 23 15:29:46.203906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: da1811a65421483f9fed0285deca97a2 May 23 15:29:46.203906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-VolumesNegativeTest-1514237778 May 23 15:29:46.203906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-VolumesNegativeTest-1514237778-project May 23 15:29:46.203906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:29:46.203906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:29:46.203906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: bd79f566bbcd4725b358eea50996447a May 23 15:29:46.203906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-VolumesNegativeTest-1514237778-project May 23 15:29:46.203906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: May 23 15:29:46.203906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1720801736", "metadata": {"Type": "work"}}} May 23 15:29:46.203906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: May 23 15:29:46.203906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1720801736', 'metadata': {'Type': 'work'}}}} May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise error May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi '0' May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:29:46.204636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 15:29:46.205971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 15:29:46.207030 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 15:29:46.207030 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:46.208742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1323f295-a123-4625-ab19-dde1d29a6bb2 tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:29:46.209945 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1323f295-a123-4625-ab19-dde1d29a6bb2 tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.388088 May 23 15:29:46.211016 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 1/2] 10.222.0.30 () {60 vars in 1155 bytes} [Mon May 23 15:29:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 390 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 23 15:29:46.233146 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4472d328-441e-41e0-b20e-c3f93006d54c tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Action: 'create', calling method: .version_select at 0x7f0d7c357f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1839069904", "metadata": {"Type": "work"}}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4472d328-441e-41e0-b20e-c3f93006d54c tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Request method failure captured: May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 119 May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6hoTPnDEA4A50ZZP1sDVqnEkLaDv7wxUrZLjvgIyYyQ0EWQQu7gaZyy293_gNaKlMjN2HVEyuTBoVxs5derIy2-nxsoMWlF9AA0zTsckXkOb0MxG5Yw4TUzqVQLSdPQDB_JYy_AHp2xbWt7Dylglgrizpd1XSZenKKMOAt67uU1GcU May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: da1811a65421483f9fed0285deca97a2 May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-VolumesNegativeTest-1514237778 May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:29:46.237979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:29:46.239412 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/da1811a65421483f9fed0285deca97a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da1811a65421483f9fed0285deca97a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da1811a65421483f9fed0285deca97a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_da1811a65421483f9fed0285deca97a2", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:29:46.239412 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-VolumesNegativeTest-1514237778 May 23 15:29:46.239412 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: da1811a65421483f9fed0285deca97a2 May 23 15:29:46.239412 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-VolumesNegativeTest-1514237778 May 23 15:29:46.239412 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-VolumesNegativeTest-1514237778-project May 23 15:29:46.239412 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:29:46.239412 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:29:46.239412 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: bd79f566bbcd4725b358eea50996447a May 23 15:29:46.239412 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-VolumesNegativeTest-1514237778-project May 23 15:29:46.239412 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: May 23 15:29:46.239412 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1839069904", "metadata": {"Type": "work"}}} May 23 15:29:46.239412 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: May 23 15:29:46.239412 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1839069904', 'metadata': {'Type': 'work'}}}} May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise error May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi '' May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:29:46.240168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 15:29:46.241849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 15:29:46.250059 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 15:29:46.250059 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:46.261349 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4472d328-441e-41e0-b20e-c3f93006d54c tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:29:46.262911 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4472d328-441e-41e0-b20e-c3f93006d54c tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.040343 May 23 15:29:46.280277 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 2/3] 10.222.0.30 () {60 vars in 1155 bytes} [Mon May 23 15:29:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 15:29:46.288131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-2b88bae4-8aa3-4975-83b5-dfbe9fe62480 tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Calling method '.version_select at 0x7f0d7c4458b0>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:46.375145 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=3 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:46.379482 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=3 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:46.381134 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=3 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:46.384109 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=3 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:46.916304 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-2b88bae4-8aa3-4975-83b5-dfbe9fe62480 tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] HTTP exception thrown: Volume tempest-invalid-56312304 could not be found. May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-2b88bae4-8aa3-4975-83b5-dfbe9fe62480 tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Request method failure captured: May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-56312304 HTTP/1.1 May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6hoTPnDEA4A50ZZP1sDVqnEkLaDv7wxUrZLjvgIyYyQ0EWQQu7gaZyy293_gNaKlMjN2HVEyuTBoVxs5derIy2-nxsoMWlF9AA0zTsckXkOb0MxG5Yw4TUzqVQLSdPQDB_JYy_AHp2xbWt7Dylglgrizpd1XSZenKKMOAt67uU1GcU May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: da1811a65421483f9fed0285deca97a2 May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-VolumesNegativeTest-1514237778 May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:29:46.921786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:29:46.923359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/da1811a65421483f9fed0285deca97a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da1811a65421483f9fed0285deca97a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da1811a65421483f9fed0285deca97a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_da1811a65421483f9fed0285deca97a2", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:29:46.923359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-VolumesNegativeTest-1514237778 May 23 15:29:46.923359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: da1811a65421483f9fed0285deca97a2 May 23 15:29:46.923359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-VolumesNegativeTest-1514237778 May 23 15:29:46.923359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-VolumesNegativeTest-1514237778-project May 23 15:29:46.923359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:29:46.923359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:29:46.923359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: bd79f566bbcd4725b358eea50996447a May 23 15:29:46.923359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-VolumesNegativeTest-1514237778-project May 23 15:29:46.923359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: May 23 15:29:46.923359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Volume tempest-invalid-56312304 could not be found. May 23 15:29:46.923359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': 'tempest-invalid-56312304'} May 23 15:29:46.923359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-56312304 could not be found. (HTTP 404) (Request-ID: req-8043a52c-78e1-401e-bac7-553ec863cc31) May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:29:46.924250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 15:29:46.925636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-56312304 could not be found. May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:29:46.926934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-56312304 could not be found. May 23 15:29:46.928400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:46.928400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:29:46.928400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:46.928400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:46.928400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:29:46.928400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:29:46.928400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:29:46.928400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:29:46.928400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-56312304 could not be found. May 23 15:29:46.928400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:46.928400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-2b88bae4-8aa3-4975-83b5-dfbe9fe62480 tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Returning 404 to user: Volume tempest-invalid-56312304 could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:29:46.928400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-2b88bae4-8aa3-4975-83b5-dfbe9fe62480 tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-56312304" status: 404 len: 97 microversion: 2.1 time: 0.647707 May 23 15:29:46.929935 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1211 bytes} [Mon May 23 15:29:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-56312304 => generated 97 bytes in 655 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 23 15:29:46.937676 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5e48d5c7-fb1c-4bf2-8079-a78a1bc7072b tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005551 May 23 15:29:46.944112 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 3/5] 10.222.0.30 () {58 vars in 1139 bytes} [Mon May 23 15:29:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 23 15:29:46.983707 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-59cffccc-ff4f-404f-aede-dd2b351e0c83 tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.030760 May 23 15:29:46.984349 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 3/6] 10.222.0.30 () {58 vars in 1136 bytes} [Mon May 23 15:29:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 23 15:29:46.994398 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f0903b04-eb70-4da3-af42-19434027cb4c tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Calling method '.version_select at 0x7f0d7c470d30>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:47.353648 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-f0903b04-eb70-4da3-af42-19434027cb4c tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] HTTP exception thrown: Volume 5b129421-f339-46ea-bf91-8a05f67daf08 could not be found. May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f0903b04-eb70-4da3-af42-19434027cb4c tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Request method failure captured: May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: DELETE /compute/v2.1/os-volumes/5b129421-f339-46ea-bf91-8a05f67daf08 HTTP/1.1 May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6hoTPnDEA4A50ZZP1sDVqnEkLaDv7wxUrZLjvgIyYyQ0EWQQu7gaZyy293_gNaKlMjN2HVEyuTBoVxs5derIy2-nxsoMWlF9AA0zTsckXkOb0MxG5Yw4TUzqVQLSdPQDB_JYy_AHp2xbWt7Dylglgrizpd1XSZenKKMOAt67uU1GcU May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: da1811a65421483f9fed0285deca97a2 May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-VolumesNegativeTest-1514237778 May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:29:47.358901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:29:47.360180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/da1811a65421483f9fed0285deca97a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da1811a65421483f9fed0285deca97a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da1811a65421483f9fed0285deca97a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_da1811a65421483f9fed0285deca97a2", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:29:47.360180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-VolumesNegativeTest-1514237778 May 23 15:29:47.360180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: da1811a65421483f9fed0285deca97a2 May 23 15:29:47.360180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-VolumesNegativeTest-1514237778 May 23 15:29:47.360180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-VolumesNegativeTest-1514237778-project May 23 15:29:47.360180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:29:47.360180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:29:47.360180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: bd79f566bbcd4725b358eea50996447a May 23 15:29:47.360180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-VolumesNegativeTest-1514237778-project May 23 15:29:47.360180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: May 23 15:29:47.360180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Volume 5b129421-f339-46ea-bf91-8a05f67daf08 could not be found. May 23 15:29:47.360180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '5b129421-f339-46ea-bf91-8a05f67daf08'} May 23 15:29:47.360180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b129421-f339-46ea-bf91-8a05f67daf08 could not be found. (HTTP 404) (Request-ID: req-569c499b-c0e8-411a-b747-c25ab2c2822d) May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:29:47.361041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 15:29:47.362106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b129421-f339-46ea-bf91-8a05f67daf08 could not be found. May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 15:29:47.363150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:29:47.364308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b129421-f339-46ea-bf91-8a05f67daf08 could not be found. May 23 15:29:47.364308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:47.364308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:29:47.364308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:47.364308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:47.364308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:29:47.364308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:29:47.364308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:29:47.364308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:29:47.364308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b129421-f339-46ea-bf91-8a05f67daf08 could not be found. May 23 15:29:47.364308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:29:47.367987 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f0903b04-eb70-4da3-af42-19434027cb4c tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Returning 404 to user: Volume 5b129421-f339-46ea-bf91-8a05f67daf08 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:29:47.370559 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f0903b04-eb70-4da3-af42-19434027cb4c tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/5b129421-f339-46ea-bf91-8a05f67daf08" status: 404 len: 109 microversion: 2.1 time: 0.380772 May 23 15:29:47.373403 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 15:29:46 2022] DELETE /compute/v2.1/os-volumes/5b129421-f339-46ea-bf91-8a05f67daf08 => generated 109 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:29:47.383522 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-976ed22d-3f91-499b-b506-b369eaccf540 tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Calling method '.version_select at 0x7f0d7c24d3a0>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:47.446621 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-976ed22d-3f91-499b-b506-b369eaccf540 tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] HTTP exception thrown: Volume 4f0980df-d725-4abf-a4b4-7d1db2591ac1 could not be found. May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-976ed22d-3f91-499b-b506-b369eaccf540 tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Request method failure captured: May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: GET /compute/v2.1/os-volumes/4f0980df-d725-4abf-a4b4-7d1db2591ac1 HTTP/1.1 May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6hoTPnDEA4A50ZZP1sDVqnEkLaDv7wxUrZLjvgIyYyQ0EWQQu7gaZyy293_gNaKlMjN2HVEyuTBoVxs5derIy2-nxsoMWlF9AA0zTsckXkOb0MxG5Yw4TUzqVQLSdPQDB_JYy_AHp2xbWt7Dylglgrizpd1XSZenKKMOAt67uU1GcU May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: da1811a65421483f9fed0285deca97a2 May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-VolumesNegativeTest-1514237778 May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:29:47.449561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:29:47.451908 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/da1811a65421483f9fed0285deca97a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da1811a65421483f9fed0285deca97a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da1811a65421483f9fed0285deca97a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_da1811a65421483f9fed0285deca97a2", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:29:47.451908 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-VolumesNegativeTest-1514237778 May 23 15:29:47.451908 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: da1811a65421483f9fed0285deca97a2 May 23 15:29:47.451908 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-VolumesNegativeTest-1514237778 May 23 15:29:47.451908 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-VolumesNegativeTest-1514237778-project May 23 15:29:47.451908 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:29:47.451908 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:29:47.451908 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: bd79f566bbcd4725b358eea50996447a May 23 15:29:47.451908 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-VolumesNegativeTest-1514237778-project May 23 15:29:47.451908 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: May 23 15:29:47.451908 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Volume 4f0980df-d725-4abf-a4b4-7d1db2591ac1 could not be found. May 23 15:29:47.451908 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': '4f0980df-d725-4abf-a4b4-7d1db2591ac1'} May 23 15:29:47.451908 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f0980df-d725-4abf-a4b4-7d1db2591ac1 could not be found. (HTTP 404) (Request-ID: req-c198983e-4a12-4de0-88d9-acc79189efde) May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:29:47.452754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:29:47.454462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f0980df-d725-4abf-a4b4-7d1db2591ac1 could not be found. May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 15:29:47.458445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:29:47.461473 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f0980df-d725-4abf-a4b4-7d1db2591ac1 could not be found. May 23 15:29:47.461473 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:47.461473 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:29:47.461473 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:47.461473 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:29:47.461473 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:29:47.461473 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:29:47.461473 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:29:47.461473 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:29:47.461473 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f0980df-d725-4abf-a4b4-7d1db2591ac1 could not be found. May 23 15:29:47.461473 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:29:47.465277 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-976ed22d-3f91-499b-b506-b369eaccf540 tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] Returning 404 to user: Volume 4f0980df-d725-4abf-a4b4-7d1db2591ac1 could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:29:47.465277 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-976ed22d-3f91-499b-b506-b369eaccf540 tempest-VolumesNegativeTest-1514237778 tempest-VolumesNegativeTest-1514237778-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/4f0980df-d725-4abf-a4b4-7d1db2591ac1" status: 404 len: 109 microversion: 2.1 time: 0.086634 May 23 15:29:47.466586 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 15:29:47 2022] GET /compute/v2.1/os-volumes/4f0980df-d725-4abf-a4b4-7d1db2591ac1 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:29:47.626925 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b5837178-d101-4886-8ecd-ef758a2d3f46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1285038794", "imageRef": "807d39e3-2293-48ca-b2cd-675f7c931014", "flavorRef": "452", "networks": [{"uuid": "fe3a15ce-dd5c-42b5-8430-0a77f338fb71"}]}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:29:47.756730 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.network.neutron [None req-b5837178-d101-4886-8ecd-ef758a2d3f46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] validate_networks() for [('fe3a15ce-dd5c-42b5-8430-0a77f338fb71', None, None, None, None, None)] {{(pid=117974) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:29:48.675816 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-0c3636b1-1da1-4b23-bd2f-bebe0a134ac5 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] Calling method '.version_select at 0x7f0d7c252040>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:48.752824 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-0c3636b1-1da1-4b23-bd2f-bebe0a134ac5 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/83615d9a-1475-4130-ac57-8f5ce1eea299" status: 200 len: 350 microversion: 2.1 time: 0.080618 May 23 15:29:48.756983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 5/9] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 15:29:48 2022] GET /compute/v2.1/os-volumes/83615d9a-1475-4130-ac57-8f5ce1eea299 => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:29:50.135151 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-b5837178-d101-4886-8ecd-ef758a2d3f46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Flavor limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:29:50.135642 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-b5837178-d101-4886-8ecd-ef758a2d3f46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Image limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:29:50.136288 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-b5837178-d101-4886-8ecd-ef758a2d3f46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Flavor pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:29:50.137470 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-b5837178-d101-4886-8ecd-ef758a2d3f46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Image pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:29:50.137889 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-b5837178-d101-4886-8ecd-ef758a2d3f46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:29:50.170188 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b5837178-d101-4886-8ecd-ef758a2d3f46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:29:50.170962 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b5837178-d101-4886-8ecd-ef758a2d3f46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:29:50.175857 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b5837178-d101-4886-8ecd-ef758a2d3f46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:29:50.178662 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b5837178-d101-4886-8ecd-ef758a2d3f46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:29:50.276233 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-b5837178-d101-4886-8ecd-ef758a2d3f46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Getting quotas for project 377219e53ce94ab089e48437d3468663. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:29:50.293356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-b5837178-d101-4886-8ecd-ef758a2d3f46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Getting quotas for user e91e38a712074ca5a2567da012445aa3 and project 377219e53ce94ab089e48437d3468663. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:29:50.354774 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b5837178-d101-4886-8ecd-ef758a2d3f46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Going to run 1 instances... {{(pid=117974) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:29:50.369985 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b5837178-d101-4886-8ecd-ef758a2d3f46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='807d39e3-2293-48ca-b2cd-675f7c931014',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:29:50.509731 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b5837178-d101-4886-8ecd-ef758a2d3f46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.027201 May 23 15:29:50.510438 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 5/10] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:29:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:29:50.522703 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-062a998e-1104-48b8-a945-4354a47cc299 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:50.524041 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-062a998e-1104-48b8-a945-4354a47cc299 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:29:50.809582 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-42bb3695-9eb7-47c9-941a-41ec204cd136 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] Calling method '.version_select at 0x7f0d7b954ca0>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:50.960684 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-062a998e-1104-48b8-a945-4354a47cc299 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:29:50.994208 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-062a998e-1104-48b8-a945-4354a47cc299 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1215 microversion: 2.1 time: 0.475932 May 23 15:29:50.998145 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 6/11] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:29:50 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1215 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:29:51.039318 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-42bb3695-9eb7-47c9-941a-41ec204cd136 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/4a4121b0-c3cd-4e79-8802-6aacb088f14a" status: 200 len: 350 microversion: 2.1 time: 0.245201 May 23 15:29:51.040005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 15:29:50 2022] GET /compute/v2.1/os-volumes/4a4121b0-c3cd-4e79-8802-6aacb088f14a => generated 350 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:29:52.020283 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-6f66775e-52d5-4424-ad6a-169c8af62971 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:52.021061 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-6f66775e-52d5-4424-ad6a-169c8af62971 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:29:52.227366 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-6f66775e-52d5-4424-ad6a-169c8af62971 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:29:52.241231 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-6f66775e-52d5-4424-ad6a-169c8af62971 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1215 microversion: 2.1 time: 0.229960 May 23 15:29:52.245701 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:29:52 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1215 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:29:52.853885 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-def2c053-22bb-4383-9137-4838fae8e310 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] Calling method '.version_select at 0x7f0d7b954d30>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:53.006526 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-def2c053-22bb-4383-9137-4838fae8e310 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/6c06f92d-1ba2-493e-9f03-57078a43eb22" status: 200 len: 350 microversion: 2.1 time: 0.159607 May 23 15:29:53.007423 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 7/14] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 15:29:52 2022] GET /compute/v2.1/os-volumes/6c06f92d-1ba2-493e-9f03-57078a43eb22 => generated 350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:29:53.019711 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ab48b74f-315c-4d50-82ae-27c9181c9916 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] Calling method '.version_select at 0x7f0d7c210040>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:53.265133 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2d21e49c-9e6a-4d40-a8a5-b0d390d06b3d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:53.266062 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-2d21e49c-9e6a-4d40-a8a5-b0d390d06b3d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:29:53.274435 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ab48b74f-315c-4d50-82ae-27c9181c9916 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.258862 May 23 15:29:53.275488 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 8/15] 10.222.0.30 () {58 vars in 1133 bytes} [Mon May 23 15:29:53 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:29:53.289223 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-93c877d0-c6d9-4321-8b06-42c2dd67740c tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] Calling method '.version_select at 0x7f0d7c210e50>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:53.598617 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-93c877d0-c6d9-4321-8b06-42c2dd67740c tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.313828 May 23 15:29:53.599175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 9/16] 10.222.0.30 () {58 vars in 1148 bytes} [Mon May 23 15:29:53 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:29:53.619172 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-4b27da2a-c2fc-427d-be67-62793253a9aa tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] Calling method '.version_select at 0x7f0d7c208ca0>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:53.723342 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-2d21e49c-9e6a-4d40-a8a5-b0d390d06b3d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:29:53.752448 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-2d21e49c-9e6a-4d40-a8a5-b0d390d06b3d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1215 microversion: 2.1 time: 0.492389 May 23 15:29:53.774166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 8/17] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:29:53 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1215 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:29:53.980350 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-4b27da2a-c2fc-427d-be67-62793253a9aa tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.371019 May 23 15:29:53.981146 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 10/18] 10.222.0.30 () {58 vars in 1133 bytes} [Mon May 23 15:29:53 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:29:53.994246 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5a580adc-5e21-4bfe-bf05-84a79cc4fa57 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] Calling method '.version_select at 0x7f0d7b104040>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:54.203756 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5a580adc-5e21-4bfe-bf05-84a79cc4fa57 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.213266 May 23 15:29:54.206630 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 9/19] 10.222.0.30 () {58 vars in 1166 bytes} [Mon May 23 15:29:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:29:54.223674 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3e3f3069-c8e5-4423-a7dc-99c2e4c86089 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] Calling method '.version_select at 0x7f0d7c210310>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:54.452098 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-3e3f3069-c8e5-4423-a7dc-99c2e4c86089 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.235268 May 23 15:29:54.462129 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 11/20] 10.222.0.30 () {58 vars in 1169 bytes} [Mon May 23 15:29:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:29:54.469819 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-34a125ef-e6ee-4aa6-bb8d-c88871585429 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] Calling method '.version_select at 0x7f0d7b971a60>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:54.717258 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-34a125ef-e6ee-4aa6-bb8d-c88871585429 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.252017 May 23 15:29:54.718579 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 10/21] 10.222.0.30 () {58 vars in 1154 bytes} [Mon May 23 15:29:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:29:54.730761 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ac6080f4-ce64-4cf3-aefb-c98fe56a4762 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] Calling method '.version_select at 0x7f0d7c21a8b0>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:54.794922 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f8662bd4-727f-4db1-9d0c-ee8c266d1045 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:54.795788 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f8662bd4-727f-4db1-9d0c-ee8c266d1045 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:29:54.808033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f8662bd4-727f-4db1-9d0c-ee8c266d1045 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:29:54.819871 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f8662bd4-727f-4db1-9d0c-ee8c266d1045 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:29:54.821363 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f8662bd4-727f-4db1-9d0c-ee8c266d1045 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:29:54.823095 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f8662bd4-727f-4db1-9d0c-ee8c266d1045 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:29:54.948383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ac6080f4-ce64-4cf3-aefb-c98fe56a4762 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.222096 May 23 15:29:54.949977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 12/22] 10.222.0.30 () {58 vars in 1187 bytes} [Mon May 23 15:29:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:29:54.964142 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-43db059a-3a0a-4863-90cb-80a00ab727e1 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] Calling method '.version_select at 0x7f0d7c21ac10>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:55.178895 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-43db059a-3a0a-4863-90cb-80a00ab727e1 tempest-VolumesTestJSON-2071774040 tempest-VolumesTestJSON-2071774040-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.219067 May 23 15:29:55.192776 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 13/23] 10.222.0.30 () {58 vars in 1154 bytes} [Mon May 23 15:29:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:29:55.270797 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-f8662bd4-727f-4db1-9d0c-ee8c266d1045 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:29:55.293533 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f8662bd4-727f-4db1-9d0c-ee8c266d1045 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1267 microversion: 2.1 time: 0.504909 May 23 15:29:55.296894 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 11/24] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:29:54 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1267 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:29:56.314773 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f4d04e39-7bdb-4752-b8f2-9d37a0599530 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:56.315394 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f4d04e39-7bdb-4752-b8f2-9d37a0599530 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:29:56.331256 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f4d04e39-7bdb-4752-b8f2-9d37a0599530 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:29:56.331864 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f4d04e39-7bdb-4752-b8f2-9d37a0599530 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:29:56.339520 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f4d04e39-7bdb-4752-b8f2-9d37a0599530 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:29:56.345545 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f4d04e39-7bdb-4752-b8f2-9d37a0599530 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:29:56.851878 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f4d04e39-7bdb-4752-b8f2-9d37a0599530 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:29:56.876362 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f4d04e39-7bdb-4752-b8f2-9d37a0599530 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1273 microversion: 2.1 time: 0.567233 May 23 15:29:56.884254 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 14/25] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:29:56 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1273 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:29:57.900177 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-7e4beead-c7fe-4b1d-b0b7-f0be36c5325f tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:57.901549 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-7e4beead-c7fe-4b1d-b0b7-f0be36c5325f tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:29:57.923012 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7e4beead-c7fe-4b1d-b0b7-f0be36c5325f tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:29:57.925478 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7e4beead-c7fe-4b1d-b0b7-f0be36c5325f tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:29:57.926495 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7e4beead-c7fe-4b1d-b0b7-f0be36c5325f tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:29:57.933648 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7e4beead-c7fe-4b1d-b0b7-f0be36c5325f tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:29:58.435262 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-7e4beead-c7fe-4b1d-b0b7-f0be36c5325f tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:29:58.443796 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-7e4beead-c7fe-4b1d-b0b7-f0be36c5325f tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1273 microversion: 2.1 time: 0.548119 May 23 15:29:58.454093 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 12/26] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:29:57 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1273 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:29:59.472847 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7aa6be48-f5f4-4c7c-9d8b-d13def479127 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:29:59.473526 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7aa6be48-f5f4-4c7c-9d8b-d13def479127 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:29:59.491449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7aa6be48-f5f4-4c7c-9d8b-d13def479127 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:29:59.495461 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7aa6be48-f5f4-4c7c-9d8b-d13def479127 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:29:59.498951 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7aa6be48-f5f4-4c7c-9d8b-d13def479127 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:29:59.501949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7aa6be48-f5f4-4c7c-9d8b-d13def479127 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:00.294762 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-7aa6be48-f5f4-4c7c-9d8b-d13def479127 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:00.304740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7aa6be48-f5f4-4c7c-9d8b-d13def479127 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1273 microversion: 2.1 time: 0.836421 May 23 15:30:00.311157 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 15/27] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:29:59 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1273 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:01.329367 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-783c0841-6816-445b-b545-7dd821691360 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:01.330628 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-783c0841-6816-445b-b545-7dd821691360 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:01.346271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=2 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:01.348733 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-783c0841-6816-445b-b545-7dd821691360 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:01.357571 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-783c0841-6816-445b-b545-7dd821691360 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:01.363327 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-783c0841-6816-445b-b545-7dd821691360 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:01.363994 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-783c0841-6816-445b-b545-7dd821691360 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:02.387176 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-783c0841-6816-445b-b545-7dd821691360 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:02.421083 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-783c0841-6816-445b-b545-7dd821691360 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1315 microversion: 2.1 time: 1.095153 May 23 15:30:02.423085 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 13/28] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:01 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1315 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:03.446269 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-9df12277-bf12-486e-85f4-99734b2714aa tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:03.447042 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-9df12277-bf12-486e-85f4-99734b2714aa tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:03.457919 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=4 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:03.476504 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9df12277-bf12-486e-85f4-99734b2714aa tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:03.479125 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9df12277-bf12-486e-85f4-99734b2714aa tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:03.485529 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9df12277-bf12-486e-85f4-99734b2714aa tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:03.488027 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9df12277-bf12-486e-85f4-99734b2714aa tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:03.735924 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=8 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:04.248668 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-60c9118d-c1dd-4b5a-9261-e06ea2ef6bba tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Action: 'create', calling method: .version_select at 0x7f0d7b05b040>, body: {"keypair": {"name": "tempest-keypair-2078259863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTIbo5j+epJ89qDQu0Y5l+K3k1ccZzv3bOK5NOJy9m+/Wo1Q//Wp13Z5X+dlD/iTF9Meo96B24u3bP/XdPcrgEviS861V12emR1RYT4jgrTevr9jaddJUqVgd1ih3zGbA=="}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:04.355316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-60c9118d-c1dd-4b5a-9261-e06ea2ef6bba tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Getting quotas for project 65c6b1563c424330ade1ef15f8efa110. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:30:04.376394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-60c9118d-c1dd-4b5a-9261-e06ea2ef6bba tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Getting quotas for user 139e3e42acff4c4ca8df0a7c4fc81053 and project 65c6b1563c424330ade1ef15f8efa110. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:30:04.491569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-60c9118d-c1dd-4b5a-9261-e06ea2ef6bba tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.841396 May 23 15:30:04.492191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 14/29] 10.222.0.30 () {62 vars in 1199 bytes} [Mon May 23 15:30:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 843 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 23 15:30:06.892807 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9df12277-bf12-486e-85f4-99734b2714aa tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:06.911518 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-9df12277-bf12-486e-85f4-99734b2714aa tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1315 microversion: 2.1 time: 3.472873 May 23 15:30:06.920475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 16/30] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:03 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1315 bytes in 3483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:08.309334 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-09ee6e53-aa1b-4493-a98d-e4ad7147e030 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Action: 'create', calling method: .version_select at 0x7f0d7b05be50>, body: {"keypair": {"name": "tempest-keypair-227834710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHpilq0deVFKSAk+NpseQ0ksOPT487VZGWo9djPuUjA2W0WanaO5mrCJT9JEsCnWkdZrWGp57B9oPD/g+4xtqHOzBlj4BQsXnGsfjPFBoTeQzLiLtxrMbdnDRiBnO11KQ=="}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:08.380305 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-09ee6e53-aa1b-4493-a98d-e4ad7147e030 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Getting quotas for project f2020e2bf35744af9161d7cf3e8bd345. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:30:08.389142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-09ee6e53-aa1b-4493-a98d-e4ad7147e030 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Getting quotas for user 06431315dc8040cbbafbe83a3ed8e0e4 and project f2020e2bf35744af9161d7cf3e8bd345. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:30:08.521702 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-09ee6e53-aa1b-4493-a98d-e4ad7147e030 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.004060 May 23 15:30:08.522406 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 15/31] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 15:30:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:30:08.544809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-424e546d-c317-4bc0-95e9-e48be4cb2c84 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:08.558731 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-424e546d-c317-4bc0-95e9-e48be4cb2c84 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:08.607956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-424e546d-c317-4bc0-95e9-e48be4cb2c84 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:08.616163 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-424e546d-c317-4bc0-95e9-e48be4cb2c84 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:08.617441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-424e546d-c317-4bc0-95e9-e48be4cb2c84 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:08.633548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-424e546d-c317-4bc0-95e9-e48be4cb2c84 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:08.832484 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-28a01dd1-bbe3-4595-9e0c-477d8a55bc03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1583109004", "imageRef": "807d39e3-2293-48ca-b2cd-675f7c931014", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:09.168519 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.network.neutron [None req-28a01dd1-bbe3-4595-9e0c-477d8a55bc03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] validate_networks() for [('0d1e2450-f071-48af-a078-8358b70cb4cd', None, None, None, None, None)] {{(pid=117973) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:30:09.611072 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-424e546d-c317-4bc0-95e9-e48be4cb2c84 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:09.633471 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-424e546d-c317-4bc0-95e9-e48be4cb2c84 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1315 microversion: 2.1 time: 1.109902 May 23 15:30:09.636982 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 16/32] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:08 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1315 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:10.586114 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-5e14b7fc-6964-4085-83b3-81ba35ca3557 req-cdc95874-09fc-45e4-bc5a-6539eb2e212d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7abcf413-0c08-4f11-b030-2f2f9f09a5a3", "tag": "07333c01-2c53-4cf7-a086-18422eb283db"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:10.628810 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-5e14b7fc-6964-4085-83b3-81ba35ca3557 req-cdc95874-09fc-45e4-bc5a-6539eb2e212d service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:10.632774 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-5e14b7fc-6964-4085-83b3-81ba35ca3557 req-cdc95874-09fc-45e4-bc5a-6539eb2e212d service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:10.726692 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-5e14b7fc-6964-4085-83b3-81ba35ca3557 req-cdc95874-09fc-45e4-bc5a-6539eb2e212d service nova] Creating event network-changed:07333c01-2c53-4cf7-a086-18422eb283db for instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 on hv-cinder-84112 May 23 15:30:10.748726 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-5e14b7fc-6964-4085-83b3-81ba35ca3557 req-cdc95874-09fc-45e4-bc5a-6539eb2e212d service nova] Acquired lock "compute-rpcapi-router" {{(pid=117974) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 15:30:10.756053 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9bd811ff-6f5a-4568-a95f-793ed634ea05 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:10.757475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9bd811ff-6f5a-4568-a95f-793ed634ea05 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:10.766280 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9bd811ff-6f5a-4568-a95f-793ed634ea05 None None] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:10.767430 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9bd811ff-6f5a-4568-a95f-793ed634ea05 None None] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:10.838892 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.compute.rpcapi [None req-9bd811ff-6f5a-4568-a95f-793ed634ea05 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 15:30:10.841803 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9bd811ff-6f5a-4568-a95f-793ed634ea05 None None] Releasing lock "compute-rpcapi-router" {{(pid=117974) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 15:30:10.916656 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-9bd811ff-6f5a-4568-a95f-793ed634ea05 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.276572 May 23 15:30:10.917683 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 17/33] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:30:10.931048 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f5396473-ae11-41ca-a646-70729c3b8cce tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:10.933594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f5396473-ae11-41ca-a646-70729c3b8cce tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:10.952647 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f5396473-ae11-41ca-a646-70729c3b8cce tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:10.962760 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f5396473-ae11-41ca-a646-70729c3b8cce tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:10.967059 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f5396473-ae11-41ca-a646-70729c3b8cce tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:10.969014 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f5396473-ae11-41ca-a646-70729c3b8cce tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:13.287712 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-f5396473-ae11-41ca-a646-70729c3b8cce tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:13.310300 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f5396473-ae11-41ca-a646-70729c3b8cce tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1315 microversion: 2.1 time: 2.385547 May 23 15:30:13.321682 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 18/34] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:10 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1315 bytes in 2403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:13.811348 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-28a01dd1-bbe3-4595-9e0c-477d8a55bc03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Flavor limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:30:13.811860 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-28a01dd1-bbe3-4595-9e0c-477d8a55bc03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Image limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:30:13.812557 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-28a01dd1-bbe3-4595-9e0c-477d8a55bc03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Flavor pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:30:13.813127 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-28a01dd1-bbe3-4595-9e0c-477d8a55bc03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Image pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:30:13.813687 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-28a01dd1-bbe3-4595-9e0c-477d8a55bc03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:30:13.848492 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-28a01dd1-bbe3-4595-9e0c-477d8a55bc03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:13.849215 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-28a01dd1-bbe3-4595-9e0c-477d8a55bc03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:13.851244 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-28a01dd1-bbe3-4595-9e0c-477d8a55bc03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:13.852443 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-28a01dd1-bbe3-4595-9e0c-477d8a55bc03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:13.970527 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-28a01dd1-bbe3-4595-9e0c-477d8a55bc03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Getting quotas for project 0712b807a4584f7b8f019ceb65ff1e14. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:30:14.013376 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-28a01dd1-bbe3-4595-9e0c-477d8a55bc03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Getting quotas for user 5074b9fa045543b9a62bf751e736d0df and project 0712b807a4584f7b8f019ceb65ff1e14. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:30:14.063331 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-28a01dd1-bbe3-4595-9e0c-477d8a55bc03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Going to run 1 instances... {{(pid=117973) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:30:14.067234 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-28a01dd1-bbe3-4595-9e0c-477d8a55bc03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='807d39e3-2293-48ca-b2cd-675f7c931014',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:30:14.174580 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3eef6635-0d4c-4600-93fa-cd7e4ffa0af5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Action: 'create', calling method: .version_select at 0x7f0d7b02a4c0>, body: {"keypair": {"name": "tempest-keypair-215606660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRvDQ4cak2kE15Z8NO5iAzFO1KS/SVzwldGSaiPZicBVdHFIeNuo9wQ5V74hdrCumUPc7lfJA9u2Bmf+4ge2CDwUMfDaBqtJgZ57Wr5MrKACNmU7HKmvQgz6jS37qfWgw=="}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:14.246306 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-3eef6635-0d4c-4600-93fa-cd7e4ffa0af5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Getting quotas for project 9aaff9db173d4618929536b08d2be8f0. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:30:14.265032 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-3eef6635-0d4c-4600-93fa-cd7e4ffa0af5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Getting quotas for user d0ae34a029c14c6f826456414ac0670d and project 9aaff9db173d4618929536b08d2be8f0. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:30:14.327827 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-28a01dd1-bbe3-4595-9e0c-477d8a55bc03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.631353 May 23 15:30:14.329011 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 17/35] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:30:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 6633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:30:14.346313 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7ebd4d1b-502b-41c5-a80d-2187e570be7e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1536729131", "imageRef": "807d39e3-2293-48ca-b2cd-675f7c931014", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "751cbaf0-d17b-4cd8-950f-078d51e9414f"}], "security_groups": [{"name": "tempest-securitygroup--1895288772"}], "key_name": "tempest-keypair-2078259863", "user_data": "}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:14.369294 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3eef6635-0d4c-4600-93fa-cd7e4ffa0af5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.591208 May 23 15:30:14.377925 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 19/36] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 15:30:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:30:14.394103 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-7ae0387d-a958-4189-9ce4-f501683ff00a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:14.396519 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-7ae0387d-a958-4189-9ce4-f501683ff00a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:14.420278 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7ae0387d-a958-4189-9ce4-f501683ff00a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:14.421987 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7ae0387d-a958-4189-9ce4-f501683ff00a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:14.430075 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7ae0387d-a958-4189-9ce4-f501683ff00a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:14.434327 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7ae0387d-a958-4189-9ce4-f501683ff00a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:14.777198 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.network.neutron [None req-7ebd4d1b-502b-41c5-a80d-2187e570be7e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] validate_networks() for [('751cbaf0-d17b-4cd8-950f-078d51e9414f', None, None, None, None, None)] {{(pid=117973) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:30:15.631449 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-7ae0387d-a958-4189-9ce4-f501683ff00a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:15.639054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=41 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:15.649765 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-7ae0387d-a958-4189-9ce4-f501683ff00a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1315 microversion: 2.1 time: 1.271864 May 23 15:30:15.666055 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 20/37] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:14 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1315 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:15.688087 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-0f5d8aba-1da6-42d8-b01a-4cc5945d01a6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:15.688721 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-0f5d8aba-1da6-42d8-b01a-4cc5945d01a6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:15.706462 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:16.084232 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0f5d8aba-1da6-42d8-b01a-4cc5945d01a6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:16.096500 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-0f5d8aba-1da6-42d8-b01a-4cc5945d01a6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1222 microversion: 2.1 time: 0.429254 May 23 15:30:16.100895 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 21/38] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:15 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1222 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:16.387200 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-024ce3f4-1573-4850-bcf3-53a86fe7c793 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-84642552", "imageRef": "807d39e3-2293-48ca-b2cd-675f7c931014", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:16.639148 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.network.neutron [None req-024ce3f4-1573-4850-bcf3-53a86fe7c793 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] validate_networks() for [('0d1e2450-f071-48af-a078-8358b70cb4cd', None, None, None, None, None)] {{(pid=117974) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:30:16.793013 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-7ebd4d1b-502b-41c5-a80d-2187e570be7e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Flavor limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:30:16.794757 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-7ebd4d1b-502b-41c5-a80d-2187e570be7e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Image limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:30:16.796064 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-7ebd4d1b-502b-41c5-a80d-2187e570be7e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Flavor pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:30:16.796422 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-7ebd4d1b-502b-41c5-a80d-2187e570be7e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Image pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:30:16.798825 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-7ebd4d1b-502b-41c5-a80d-2187e570be7e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:30:16.801116 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:16.816735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7ebd4d1b-502b-41c5-a80d-2187e570be7e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:16.817727 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7ebd4d1b-502b-41c5-a80d-2187e570be7e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:16.818828 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7ebd4d1b-502b-41c5-a80d-2187e570be7e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:16.819415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7ebd4d1b-502b-41c5-a80d-2187e570be7e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:16.836353 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=21 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:16.850678 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-7ebd4d1b-502b-41c5-a80d-2187e570be7e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Getting quotas for project 65c6b1563c424330ade1ef15f8efa110. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:30:16.858300 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-7ebd4d1b-502b-41c5-a80d-2187e570be7e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Getting quotas for user 139e3e42acff4c4ca8df0a7c4fc81053 and project 65c6b1563c424330ade1ef15f8efa110. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:30:16.879098 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7ebd4d1b-502b-41c5-a80d-2187e570be7e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Going to run 1 instances... {{(pid=117973) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:30:16.882596 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7ebd4d1b-502b-41c5-a80d-2187e570be7e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='807d39e3-2293-48ca-b2cd-675f7c931014',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:30:16.959475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7ebd4d1b-502b-41c5-a80d-2187e570be7e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.629201 May 23 15:30:16.970039 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 18/39] 10.222.0.30 () {62 vars in 1187 bytes} [Mon May 23 15:30:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 2640 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 23 15:30:16.976724 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-58599e22-2ec4-4c40-b19c-518e424d8267 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:16.977940 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-58599e22-2ec4-4c40-b19c-518e424d8267 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:16.993974 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58599e22-2ec4-4c40-b19c-518e424d8267 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:16.994905 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58599e22-2ec4-4c40-b19c-518e424d8267 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:17.002227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58599e22-2ec4-4c40-b19c-518e424d8267 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:17.008456 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58599e22-2ec4-4c40-b19c-518e424d8267 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:17.234719 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-58599e22-2ec4-4c40-b19c-518e424d8267 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:17.248068 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-58599e22-2ec4-4c40-b19c-518e424d8267 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1315 microversion: 2.1 time: 0.276427 May 23 15:30:17.248952 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 19/40] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:16 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:17.253537 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-fab9b451-3ecb-41e0-977e-dc60fccfc64d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:17.254270 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-fab9b451-3ecb-41e0-977e-dc60fccfc64d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:17.339889 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-fab9b451-3ecb-41e0-977e-dc60fccfc64d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:17.349774 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-fab9b451-3ecb-41e0-977e-dc60fccfc64d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:17.351362 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-fab9b451-3ecb-41e0-977e-dc60fccfc64d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:17.352502 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-fab9b451-3ecb-41e0-977e-dc60fccfc64d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1282 microversion: 2.20 time: 0.102671 May 23 15:30:17.356494 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:30:17 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:30:18.122911 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-024ce3f4-1573-4850-bcf3-53a86fe7c793 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Flavor limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:30:18.124074 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-024ce3f4-1573-4850-bcf3-53a86fe7c793 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Image limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:30:18.124758 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-024ce3f4-1573-4850-bcf3-53a86fe7c793 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Flavor pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:30:18.126059 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-024ce3f4-1573-4850-bcf3-53a86fe7c793 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Image pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:30:18.127065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-024ce3f4-1573-4850-bcf3-53a86fe7c793 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:30:18.181305 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-024ce3f4-1573-4850-bcf3-53a86fe7c793 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:18.182816 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-024ce3f4-1573-4850-bcf3-53a86fe7c793 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:18.188252 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-024ce3f4-1573-4850-bcf3-53a86fe7c793 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:18.190658 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-024ce3f4-1573-4850-bcf3-53a86fe7c793 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:18.214192 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-024ce3f4-1573-4850-bcf3-53a86fe7c793 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Getting quotas for project 0712b807a4584f7b8f019ceb65ff1e14. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:30:18.220554 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-024ce3f4-1573-4850-bcf3-53a86fe7c793 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Getting quotas for user 5074b9fa045543b9a62bf751e736d0df and project 0712b807a4584f7b8f019ceb65ff1e14. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:30:18.245269 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-024ce3f4-1573-4850-bcf3-53a86fe7c793 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Going to run 1 instances... {{(pid=117974) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:30:18.250118 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-024ce3f4-1573-4850-bcf3-53a86fe7c793 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='807d39e3-2293-48ca-b2cd-675f7c931014',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:30:18.266546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a062c260-18fb-4954-84c1-2c9c67bffe9c tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:18.267224 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-a062c260-18fb-4954-84c1-2c9c67bffe9c tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:18.282550 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a062c260-18fb-4954-84c1-2c9c67bffe9c tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:18.284314 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a062c260-18fb-4954-84c1-2c9c67bffe9c tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:18.288403 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a062c260-18fb-4954-84c1-2c9c67bffe9c tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:18.289072 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a062c260-18fb-4954-84c1-2c9c67bffe9c tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:18.365751 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-024ce3f4-1573-4850-bcf3-53a86fe7c793 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.985158 May 23 15:30:18.381430 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:30:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 2001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 15:30:18.389662 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-451c1f4b-89cc-43e2-a1c4-57ef172189ec tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:18.390606 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-451c1f4b-89cc-43e2-a1c4-57ef172189ec tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:18.401373 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-451c1f4b-89cc-43e2-a1c4-57ef172189ec tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:18.402021 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-451c1f4b-89cc-43e2-a1c4-57ef172189ec tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:18.403048 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-451c1f4b-89cc-43e2-a1c4-57ef172189ec tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:18.412935 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-451c1f4b-89cc-43e2-a1c4-57ef172189ec tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:18.661438 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-451c1f4b-89cc-43e2-a1c4-57ef172189ec tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:18.721290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-451c1f4b-89cc-43e2-a1c4-57ef172189ec tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:18.724690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-451c1f4b-89cc-43e2-a1c4-57ef172189ec tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:18.727569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-451c1f4b-89cc-43e2-a1c4-57ef172189ec tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1286 microversion: 2.20 time: 0.343471 May 23 15:30:18.742498 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 23/43] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:30:18 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1286 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:30:18.744008 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a062c260-18fb-4954-84c1-2c9c67bffe9c tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:18.750870 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8cdd0fd8-54aa-4461-8142-8a16659dc0ae tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:18.751878 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8cdd0fd8-54aa-4461-8142-8a16659dc0ae tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:18.753023 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a062c260-18fb-4954-84c1-2c9c67bffe9c tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1315 microversion: 2.1 time: 0.491258 May 23 15:30:18.763243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 21/44] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:18 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:18.773827 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d72b6612-7073-4db8-8358-9059fdfa02f6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-200998668", "imageRef": "807d39e3-2293-48ca-b2cd-675f7c931014", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9306d40-6dd5-4f4d-bb55-9077bd7b986d"}], "security_groups": [{"name": "tempest-securitygroup--775539891"}], "key_name": "tempest-keypair-227834710", "user_data": "}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:18.954092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.network.neutron [None req-d72b6612-7073-4db8-8358-9059fdfa02f6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] validate_networks() for [('c9306d40-6dd5-4f4d-bb55-9077bd7b986d', None, None, None, None, None)] {{(pid=117973) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:30:18.963587 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-8cdd0fd8-54aa-4461-8142-8a16659dc0ae tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:18.978644 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8cdd0fd8-54aa-4461-8142-8a16659dc0ae tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1220 microversion: 2.1 time: 0.234599 May 23 15:30:18.981139 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 24/45] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:18 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1220 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:19.691776 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-7999bff2-1132-4dbb-8801-d8b2b4dce0c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-328571535", "imageRef": "807d39e3-2293-48ca-b2cd-675f7c931014", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a072baa-6965-4350-b247-fb58bbcac26a"}], "security_groups": [{"name": "tempest-securitygroup--673481401"}], "key_name": "tempest-keypair-215606660", "user_data": "}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:19.839358 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-d72b6612-7073-4db8-8358-9059fdfa02f6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Flavor limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:30:19.839966 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-d72b6612-7073-4db8-8358-9059fdfa02f6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Image limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:30:19.841030 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-d72b6612-7073-4db8-8358-9059fdfa02f6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Flavor pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:30:19.841938 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-d72b6612-7073-4db8-8358-9059fdfa02f6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Image pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:30:19.842512 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-d72b6612-7073-4db8-8358-9059fdfa02f6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:30:19.855202 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d72b6612-7073-4db8-8358-9059fdfa02f6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:19.855927 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d72b6612-7073-4db8-8358-9059fdfa02f6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:19.856936 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d72b6612-7073-4db8-8358-9059fdfa02f6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:19.857561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d72b6612-7073-4db8-8358-9059fdfa02f6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:19.898041 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-d72b6612-7073-4db8-8358-9059fdfa02f6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Getting quotas for project f2020e2bf35744af9161d7cf3e8bd345. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:30:19.930402 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-d72b6612-7073-4db8-8358-9059fdfa02f6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Getting quotas for user 06431315dc8040cbbafbe83a3ed8e0e4 and project f2020e2bf35744af9161d7cf3e8bd345. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:30:19.953325 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.network.neutron [None req-7999bff2-1132-4dbb-8801-d8b2b4dce0c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] validate_networks() for [('2a072baa-6965-4350-b247-fb58bbcac26a', None, None, None, None, None)] {{(pid=117974) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:30:19.959782 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d72b6612-7073-4db8-8358-9059fdfa02f6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Going to run 1 instances... {{(pid=117973) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:30:19.962931 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d72b6612-7073-4db8-8358-9059fdfa02f6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='807d39e3-2293-48ca-b2cd-675f7c931014',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:30:20.073728 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d72b6612-7073-4db8-8358-9059fdfa02f6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.309029 May 23 15:30:20.075569 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 22/46] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:30:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:30:20.100821 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a58633ff-e08c-4bc4-8e85-860938244602 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:20.110593 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-a58633ff-e08c-4bc4-8e85-860938244602 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:20.153983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a58633ff-e08c-4bc4-8e85-860938244602 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:20.154419 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a58633ff-e08c-4bc4-8e85-860938244602 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:20.156831 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a58633ff-e08c-4bc4-8e85-860938244602 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:20.165631 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a58633ff-e08c-4bc4-8e85-860938244602 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:20.306729 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a58633ff-e08c-4bc4-8e85-860938244602 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:20.323180 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a58633ff-e08c-4bc4-8e85-860938244602 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:20.325284 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a58633ff-e08c-4bc4-8e85-860938244602 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:20.328217 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a58633ff-e08c-4bc4-8e85-860938244602 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1334 microversion: 2.20 time: 0.240028 May 23 15:30:20.330547 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:30:20 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1334 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:30:20.339994 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f51946bf-5bf7-4da8-93ab-7da11011cda7 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:20.342560 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f51946bf-5bf7-4da8-93ab-7da11011cda7 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:20.349813 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f51946bf-5bf7-4da8-93ab-7da11011cda7 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:20.350821 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f51946bf-5bf7-4da8-93ab-7da11011cda7 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:20.352522 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f51946bf-5bf7-4da8-93ab-7da11011cda7 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:20.353222 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f51946bf-5bf7-4da8-93ab-7da11011cda7 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:20.645740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f51946bf-5bf7-4da8-93ab-7da11011cda7 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:20.660569 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f51946bf-5bf7-4da8-93ab-7da11011cda7 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1315 microversion: 2.1 time: 0.328672 May 23 15:30:20.663457 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 24/48] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:20 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:20.673318 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8299932b-ef51-415a-a04a-53e7f4338cf0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:20.675761 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8299932b-ef51-415a-a04a-53e7f4338cf0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:20.678785 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-7999bff2-1132-4dbb-8801-d8b2b4dce0c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Flavor limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:30:20.683944 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-7999bff2-1132-4dbb-8801-d8b2b4dce0c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Image limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:30:20.684838 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-7999bff2-1132-4dbb-8801-d8b2b4dce0c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Flavor pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:30:20.685617 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-7999bff2-1132-4dbb-8801-d8b2b4dce0c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Image pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:30:20.686262 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-7999bff2-1132-4dbb-8801-d8b2b4dce0c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:30:20.695879 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8299932b-ef51-415a-a04a-53e7f4338cf0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:20.697742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8299932b-ef51-415a-a04a-53e7f4338cf0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:20.701051 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8299932b-ef51-415a-a04a-53e7f4338cf0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:20.703530 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8299932b-ef51-415a-a04a-53e7f4338cf0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:20.704633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7999bff2-1132-4dbb-8801-d8b2b4dce0c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:20.705147 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7999bff2-1132-4dbb-8801-d8b2b4dce0c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:20.705908 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7999bff2-1132-4dbb-8801-d8b2b4dce0c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:20.706345 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7999bff2-1132-4dbb-8801-d8b2b4dce0c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:20.768105 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-7999bff2-1132-4dbb-8801-d8b2b4dce0c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Getting quotas for project 9aaff9db173d4618929536b08d2be8f0. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:30:20.775770 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-7999bff2-1132-4dbb-8801-d8b2b4dce0c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Getting quotas for user d0ae34a029c14c6f826456414ac0670d and project 9aaff9db173d4618929536b08d2be8f0. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:30:20.818079 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8299932b-ef51-415a-a04a-53e7f4338cf0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:20.849064 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8299932b-ef51-415a-a04a-53e7f4338cf0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1272 microversion: 2.1 time: 0.162350 May 23 15:30:20.849064 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 25/49] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:20 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:20.849064 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-06c89bd1-8682-4322-bd1f-7ad6fde3bba3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:20.849064 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-06c89bd1-8682-4322-bd1f-7ad6fde3bba3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:20.897050 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-7999bff2-1132-4dbb-8801-d8b2b4dce0c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Going to run 1 instances... {{(pid=117974) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:30:20.910796 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-06c89bd1-8682-4322-bd1f-7ad6fde3bba3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:20.919505 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-06c89bd1-8682-4322-bd1f-7ad6fde3bba3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1240 microversion: 2.1 time: 0.089450 May 23 15:30:20.923118 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 26/50] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:20 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:20.924213 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-7999bff2-1132-4dbb-8801-d8b2b4dce0c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='807d39e3-2293-48ca-b2cd-675f7c931014',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:30:21.163000 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-7999bff2-1132-4dbb-8801-d8b2b4dce0c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.474706 May 23 15:30:21.165502 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:30:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:30:21.176063 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c839abb0-2886-4471-829d-f8283f0bebc5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:21.179012 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c839abb0-2886-4471-829d-f8283f0bebc5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:21.353332 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-815b9dee-e5e9-489d-9981-68581b00352b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:21.354113 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-815b9dee-e5e9-489d-9981-68581b00352b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:21.377200 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-815b9dee-e5e9-489d-9981-68581b00352b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:21.382568 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-815b9dee-e5e9-489d-9981-68581b00352b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:21.390251 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-815b9dee-e5e9-489d-9981-68581b00352b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:21.391174 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-815b9dee-e5e9-489d-9981-68581b00352b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:21.432160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c839abb0-2886-4471-829d-f8283f0bebc5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:21.440281 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c839abb0-2886-4471-829d-f8283f0bebc5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1236 microversion: 2.1 time: 0.268165 May 23 15:30:21.440887 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 27/52] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:21 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1236 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:21.681643 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-4d18f9b4-6344-45eb-81f9-127ba34f602f tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:21.682464 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-4d18f9b4-6344-45eb-81f9-127ba34f602f tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:21.707106 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4d18f9b4-6344-45eb-81f9-127ba34f602f tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:21.711994 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4d18f9b4-6344-45eb-81f9-127ba34f602f tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:21.723972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4d18f9b4-6344-45eb-81f9-127ba34f602f tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:21.724732 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-815b9dee-e5e9-489d-9981-68581b00352b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:21.734646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4d18f9b4-6344-45eb-81f9-127ba34f602f tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:21.739707 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-815b9dee-e5e9-489d-9981-68581b00352b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:21.742303 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-815b9dee-e5e9-489d-9981-68581b00352b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:21.743502 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-815b9dee-e5e9-489d-9981-68581b00352b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1342 microversion: 2.20 time: 0.396297 May 23 15:30:21.751338 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 26/53] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:30:21 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1342 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:30:21.859522 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c6d724df-44c7-483b-98da-309347a4b5cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:21.861279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-c6d724df-44c7-483b-98da-309347a4b5cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:21.881756 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c6d724df-44c7-483b-98da-309347a4b5cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:21.883440 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c6d724df-44c7-483b-98da-309347a4b5cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:21.886675 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c6d724df-44c7-483b-98da-309347a4b5cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:21.888786 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c6d724df-44c7-483b-98da-309347a4b5cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:22.219040 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c6d724df-44c7-483b-98da-309347a4b5cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:22.230293 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-c6d724df-44c7-483b-98da-309347a4b5cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1278 microversion: 2.1 time: 0.378736 May 23 15:30:22.234174 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 27/54] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:21 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1278 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:22.249470 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-cba763e9-850b-4ea0-a9cd-996fc20f96f4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:22.250356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-cba763e9-850b-4ea0-a9cd-996fc20f96f4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:22.272984 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-cba763e9-850b-4ea0-a9cd-996fc20f96f4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:22.275916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-cba763e9-850b-4ea0-a9cd-996fc20f96f4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:22.278774 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-cba763e9-850b-4ea0-a9cd-996fc20f96f4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:22.279507 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-cba763e9-850b-4ea0-a9cd-996fc20f96f4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:22.416756 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-cba763e9-850b-4ea0-a9cd-996fc20f96f4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:22.436111 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-cba763e9-850b-4ea0-a9cd-996fc20f96f4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1292 microversion: 2.1 time: 0.199857 May 23 15:30:22.442235 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 28/55] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:22 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1292 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:22.459721 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b8274ee2-8995-48a2-a7e6-7de7daab7546 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:22.460599 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b8274ee2-8995-48a2-a7e6-7de7daab7546 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:22.473091 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b8274ee2-8995-48a2-a7e6-7de7daab7546 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:22.473704 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b8274ee2-8995-48a2-a7e6-7de7daab7546 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:22.475730 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b8274ee2-8995-48a2-a7e6-7de7daab7546 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:22.476361 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b8274ee2-8995-48a2-a7e6-7de7daab7546 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:22.510934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-4d18f9b4-6344-45eb-81f9-127ba34f602f tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:22.534373 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-4d18f9b4-6344-45eb-81f9-127ba34f602f tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1315 microversion: 2.1 time: 0.857091 May 23 15:30:22.541677 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 28/56] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:21 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1315 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:22.641024 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b8274ee2-8995-48a2-a7e6-7de7daab7546 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:22.653403 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b8274ee2-8995-48a2-a7e6-7de7daab7546 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1240 microversion: 2.1 time: 0.198197 May 23 15:30:22.654372 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 29/57] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:22 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1240 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:22.770135 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-175d55fa-90a2-4f3a-97eb-86105eee3f21 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:22.770779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-175d55fa-90a2-4f3a-97eb-86105eee3f21 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:22.787083 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-175d55fa-90a2-4f3a-97eb-86105eee3f21 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:22.787527 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-175d55fa-90a2-4f3a-97eb-86105eee3f21 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:22.788327 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-175d55fa-90a2-4f3a-97eb-86105eee3f21 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:22.792730 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-175d55fa-90a2-4f3a-97eb-86105eee3f21 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:22.990435 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-175d55fa-90a2-4f3a-97eb-86105eee3f21 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:23.004289 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-175d55fa-90a2-4f3a-97eb-86105eee3f21 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:23.015761 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-175d55fa-90a2-4f3a-97eb-86105eee3f21 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:23.023685 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-175d55fa-90a2-4f3a-97eb-86105eee3f21 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1340 microversion: 2.20 time: 0.251449 May 23 15:30:23.027119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 29/58] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:30:22 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1340 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:30:23.253495 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-577a2219-cc92-4f7f-a0e8-21f121c99539 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:23.254718 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-577a2219-cc92-4f7f-a0e8-21f121c99539 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:23.272902 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-577a2219-cc92-4f7f-a0e8-21f121c99539 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:23.273355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-577a2219-cc92-4f7f-a0e8-21f121c99539 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:23.274529 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-577a2219-cc92-4f7f-a0e8-21f121c99539 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:23.276556 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-577a2219-cc92-4f7f-a0e8-21f121c99539 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:23.459004 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-eec23d05-752e-4713-9280-80679535ae9f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:23.459928 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-eec23d05-752e-4713-9280-80679535ae9f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:23.472458 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-eec23d05-752e-4713-9280-80679535ae9f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:23.474766 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-eec23d05-752e-4713-9280-80679535ae9f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:23.476990 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-eec23d05-752e-4713-9280-80679535ae9f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:23.477620 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-eec23d05-752e-4713-9280-80679535ae9f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:23.507015 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-577a2219-cc92-4f7f-a0e8-21f121c99539 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:23.515270 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-577a2219-cc92-4f7f-a0e8-21f121c99539 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1278 microversion: 2.1 time: 0.269445 May 23 15:30:23.524756 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 30/59] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:23 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1278 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:23.555071 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-99733e0f-70be-4103-85e5-e2162f7e2827 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:23.555694 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-99733e0f-70be-4103-85e5-e2162f7e2827 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:23.571899 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-99733e0f-70be-4103-85e5-e2162f7e2827 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:23.572355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-99733e0f-70be-4103-85e5-e2162f7e2827 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:23.592294 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-99733e0f-70be-4103-85e5-e2162f7e2827 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:23.592845 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-99733e0f-70be-4103-85e5-e2162f7e2827 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:24.301469 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-eec23d05-752e-4713-9280-80679535ae9f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:24.320772 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-eec23d05-752e-4713-9280-80679535ae9f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1298 microversion: 2.1 time: 0.869704 May 23 15:30:24.325476 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 30/60] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:23 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1298 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:24.351633 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d9a735fd-e3e7-43e4-b903-4f535c8e61fe tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:24.365504 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d9a735fd-e3e7-43e4-b903-4f535c8e61fe tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:24.394552 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d9a735fd-e3e7-43e4-b903-4f535c8e61fe tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:24.395009 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d9a735fd-e3e7-43e4-b903-4f535c8e61fe tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:24.395823 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d9a735fd-e3e7-43e4-b903-4f535c8e61fe tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:24.396260 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d9a735fd-e3e7-43e4-b903-4f535c8e61fe tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:24.567529 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d9a735fd-e3e7-43e4-b903-4f535c8e61fe tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:24.589008 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d9a735fd-e3e7-43e4-b903-4f535c8e61fe tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1294 microversion: 2.1 time: 0.261310 May 23 15:30:24.592132 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 31/61] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:24 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1294 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:24.601936 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-e3f14110-4c6f-45a3-9c4b-2000c20a8aab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:24.605353 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-e3f14110-4c6f-45a3-9c4b-2000c20a8aab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:24.632406 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e3f14110-4c6f-45a3-9c4b-2000c20a8aab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:24.634719 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-99733e0f-70be-4103-85e5-e2162f7e2827 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:24.636539 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e3f14110-4c6f-45a3-9c4b-2000c20a8aab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:24.640055 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e3f14110-4c6f-45a3-9c4b-2000c20a8aab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:24.641380 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e3f14110-4c6f-45a3-9c4b-2000c20a8aab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:24.655789 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-99733e0f-70be-4103-85e5-e2162f7e2827 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1315 microversion: 2.1 time: 1.104828 May 23 15:30:24.656389 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 31/62] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:23 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1315 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:24.684438 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f151395b-d67a-42c5-bd85-7d123c83c138 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:24.687088 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f151395b-d67a-42c5-bd85-7d123c83c138 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:24.702251 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f151395b-d67a-42c5-bd85-7d123c83c138 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:24.703163 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f151395b-d67a-42c5-bd85-7d123c83c138 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:24.708244 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f151395b-d67a-42c5-bd85-7d123c83c138 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:24.709704 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f151395b-d67a-42c5-bd85-7d123c83c138 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:25.265371 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-e3f14110-4c6f-45a3-9c4b-2000c20a8aab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:25.274535 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-e3f14110-4c6f-45a3-9c4b-2000c20a8aab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:25.276249 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-e3f14110-4c6f-45a3-9c4b-2000c20a8aab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:25.278731 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-e3f14110-4c6f-45a3-9c4b-2000c20a8aab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1408 microversion: 2.20 time: 0.685420 May 23 15:30:25.279900 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 32/63] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:30:24 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1408 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:30:25.430629 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-f151395b-d67a-42c5-bd85-7d123c83c138 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:25.444979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f151395b-d67a-42c5-bd85-7d123c83c138 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1320 microversion: 2.1 time: 0.779798 May 23 15:30:25.446647 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 32/64] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:24 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1320 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:25.465644 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e0dd5d3d-fd5f-42aa-bf39-a3d8ac9c13c0 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:25.467979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e0dd5d3d-fd5f-42aa-bf39-a3d8ac9c13c0 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:25.488384 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e0dd5d3d-fd5f-42aa-bf39-a3d8ac9c13c0 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:25.490795 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e0dd5d3d-fd5f-42aa-bf39-a3d8ac9c13c0 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:25.492049 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e0dd5d3d-fd5f-42aa-bf39-a3d8ac9c13c0 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:25.493791 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e0dd5d3d-fd5f-42aa-bf39-a3d8ac9c13c0 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:25.533440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-06cd4a56-854b-4ef1-91a3-933142f2aca1 req-be74f821-7c80-4128-8ef2-909d9e9863c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7abcf413-0c08-4f11-b030-2f2f9f09a5a3", "name": "network-vif-plugged", "status": "completed", "tag": "07333c01-2c53-4cf7-a086-18422eb283db"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:25.562461 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-06cd4a56-854b-4ef1-91a3-933142f2aca1 req-be74f821-7c80-4128-8ef2-909d9e9863c8 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:25.562902 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-06cd4a56-854b-4ef1-91a3-933142f2aca1 req-be74f821-7c80-4128-8ef2-909d9e9863c8 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:25.650213 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-06cd4a56-854b-4ef1-91a3-933142f2aca1 req-be74f821-7c80-4128-8ef2-909d9e9863c8 service nova] Creating event network-vif-plugged:07333c01-2c53-4cf7-a086-18422eb283db for instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 on hv-cinder-84112 May 23 15:30:25.650923 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-06cd4a56-854b-4ef1-91a3-933142f2aca1 req-be74f821-7c80-4128-8ef2-909d9e9863c8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117973) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 15:30:25.654506 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-19223f05-8e33-40dd-8ee1-2176fb44fab5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:25.655139 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-19223f05-8e33-40dd-8ee1-2176fb44fab5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:25.656176 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-19223f05-8e33-40dd-8ee1-2176fb44fab5 None None] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:25.657189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-19223f05-8e33-40dd-8ee1-2176fb44fab5 None None] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:25.666940 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.compute.rpcapi [None req-19223f05-8e33-40dd-8ee1-2176fb44fab5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 15:30:25.668168 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-19223f05-8e33-40dd-8ee1-2176fb44fab5 None None] Releasing lock "compute-rpcapi-router" {{(pid=117973) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 15:30:25.686232 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-19223f05-8e33-40dd-8ee1-2176fb44fab5 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.404794 May 23 15:30:25.686841 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 33/65] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:30:25.692218 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-12bd39d9-d8a5-4d7c-9985-c1ff0ed40fe5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:25.692970 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-12bd39d9-d8a5-4d7c-9985-c1ff0ed40fe5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:25.701777 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-12bd39d9-d8a5-4d7c-9985-c1ff0ed40fe5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:25.702585 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-12bd39d9-d8a5-4d7c-9985-c1ff0ed40fe5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:25.703594 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-12bd39d9-d8a5-4d7c-9985-c1ff0ed40fe5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:25.704565 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-12bd39d9-d8a5-4d7c-9985-c1ff0ed40fe5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:25.756568 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e0dd5d3d-fd5f-42aa-bf39-a3d8ac9c13c0 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:25.766124 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e0dd5d3d-fd5f-42aa-bf39-a3d8ac9c13c0 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1298 microversion: 2.1 time: 0.316241 May 23 15:30:25.772389 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 33/66] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:25 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1298 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:25.778242 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-18a1bc52-6dc3-45d1-9b4c-046f322f0bf1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:25.783026 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-18a1bc52-6dc3-45d1-9b4c-046f322f0bf1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:25.789538 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-18a1bc52-6dc3-45d1-9b4c-046f322f0bf1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:25.790347 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-18a1bc52-6dc3-45d1-9b4c-046f322f0bf1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:25.791204 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-18a1bc52-6dc3-45d1-9b4c-046f322f0bf1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:25.791832 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-18a1bc52-6dc3-45d1-9b4c-046f322f0bf1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:26.157572 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-12bd39d9-d8a5-4d7c-9985-c1ff0ed40fe5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:26.172488 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-12bd39d9-d8a5-4d7c-9985-c1ff0ed40fe5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1294 microversion: 2.1 time: 0.484152 May 23 15:30:26.179221 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 34/67] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:25 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1294 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:26.299177 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-903a7fb3-3be0-4bb8-90eb-61306bff9377 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:26.299177 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-903a7fb3-3be0-4bb8-90eb-61306bff9377 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:26.310793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-903a7fb3-3be0-4bb8-90eb-61306bff9377 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:26.311544 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-903a7fb3-3be0-4bb8-90eb-61306bff9377 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:26.313065 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-903a7fb3-3be0-4bb8-90eb-61306bff9377 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:26.313815 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-903a7fb3-3be0-4bb8-90eb-61306bff9377 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:26.355380 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-18a1bc52-6dc3-45d1-9b4c-046f322f0bf1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:26.374517 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-18a1bc52-6dc3-45d1-9b4c-046f322f0bf1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1315 microversion: 2.1 time: 0.600650 May 23 15:30:26.375104 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 34/68] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:25 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:26.465166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-186eeb0b-d6f8-4252-9e2c-4c5b21d55d63 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:26.466028 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-186eeb0b-d6f8-4252-9e2c-4c5b21d55d63 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:26.481680 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-186eeb0b-d6f8-4252-9e2c-4c5b21d55d63 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:26.484446 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-186eeb0b-d6f8-4252-9e2c-4c5b21d55d63 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:26.486798 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-186eeb0b-d6f8-4252-9e2c-4c5b21d55d63 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:26.491419 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-186eeb0b-d6f8-4252-9e2c-4c5b21d55d63 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:27.142797 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-903a7fb3-3be0-4bb8-90eb-61306bff9377 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:27.154279 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-903a7fb3-3be0-4bb8-90eb-61306bff9377 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:27.155937 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-903a7fb3-3be0-4bb8-90eb-61306bff9377 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:27.161358 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-903a7fb3-3be0-4bb8-90eb-61306bff9377 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1408 microversion: 2.20 time: 0.868062 May 23 15:30:27.168981 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 35/69] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:30:26 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1408 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:30:27.195628 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-4703d2be-c92d-4d87-94ce-dfbcdf59dafb tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:27.196264 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-4703d2be-c92d-4d87-94ce-dfbcdf59dafb tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:27.225271 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4703d2be-c92d-4d87-94ce-dfbcdf59dafb tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:27.225995 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4703d2be-c92d-4d87-94ce-dfbcdf59dafb tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:27.227438 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4703d2be-c92d-4d87-94ce-dfbcdf59dafb tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:27.228037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4703d2be-c92d-4d87-94ce-dfbcdf59dafb tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:27.370304 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-186eeb0b-d6f8-4252-9e2c-4c5b21d55d63 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:27.387754 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-186eeb0b-d6f8-4252-9e2c-4c5b21d55d63 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1320 microversion: 2.1 time: 0.924989 May 23 15:30:27.388906 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 35/70] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:26 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1320 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:27.404994 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d6a7e72c-4347-4d9d-9c7d-88a2ad1abfff tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:27.411981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d6a7e72c-4347-4d9d-9c7d-88a2ad1abfff tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:27.431949 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d6a7e72c-4347-4d9d-9c7d-88a2ad1abfff tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:27.432811 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d6a7e72c-4347-4d9d-9c7d-88a2ad1abfff tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:27.439363 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d6a7e72c-4347-4d9d-9c7d-88a2ad1abfff tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:27.442802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d6a7e72c-4347-4d9d-9c7d-88a2ad1abfff tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:28.055510 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-4703d2be-c92d-4d87-94ce-dfbcdf59dafb tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:28.069151 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-4703d2be-c92d-4d87-94ce-dfbcdf59dafb tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1365 microversion: 2.1 time: 0.890234 May 23 15:30:28.072484 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 36/71] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:27 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1365 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:28.082939 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7af6f9cf-f25b-4064-ac31-d543da4ca8ef tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:28.084434 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7af6f9cf-f25b-4064-ac31-d543da4ca8ef tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:28.099871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7af6f9cf-f25b-4064-ac31-d543da4ca8ef tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:28.100321 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7af6f9cf-f25b-4064-ac31-d543da4ca8ef tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:28.102923 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7af6f9cf-f25b-4064-ac31-d543da4ca8ef tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:28.105349 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7af6f9cf-f25b-4064-ac31-d543da4ca8ef tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:28.578438 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-7af6f9cf-f25b-4064-ac31-d543da4ca8ef tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:28.593935 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7af6f9cf-f25b-4064-ac31-d543da4ca8ef tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1315 microversion: 2.1 time: 0.519845 May 23 15:30:28.595098 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 37/72] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:28 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:28.607868 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-401cac67-08c3-4a1e-a1ba-c61330328fae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:28.608481 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-401cac67-08c3-4a1e-a1ba-c61330328fae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:28.621382 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-401cac67-08c3-4a1e-a1ba-c61330328fae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:28.622459 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-401cac67-08c3-4a1e-a1ba-c61330328fae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:28.624371 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-401cac67-08c3-4a1e-a1ba-c61330328fae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:28.628095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-401cac67-08c3-4a1e-a1ba-c61330328fae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:28.706115 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d6a7e72c-4347-4d9d-9c7d-88a2ad1abfff tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:28.716039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d6a7e72c-4347-4d9d-9c7d-88a2ad1abfff tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1361 microversion: 2.1 time: 1.325026 May 23 15:30:28.722266 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 36/73] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:27 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1361 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:28.729243 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-bad8ba54-b415-4ce3-b448-1346846a543f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:28.730113 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-bad8ba54-b415-4ce3-b448-1346846a543f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:28.748933 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bad8ba54-b415-4ce3-b448-1346846a543f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:28.752129 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bad8ba54-b415-4ce3-b448-1346846a543f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:28.753853 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bad8ba54-b415-4ce3-b448-1346846a543f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:28.755748 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bad8ba54-b415-4ce3-b448-1346846a543f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:29.424236 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-401cac67-08c3-4a1e-a1ba-c61330328fae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:29.433465 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-401cac67-08c3-4a1e-a1ba-c61330328fae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:29.436024 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-401cac67-08c3-4a1e-a1ba-c61330328fae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:29.452291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-401cac67-08c3-4a1e-a1ba-c61330328fae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1408 microversion: 2.20 time: 0.841134 May 23 15:30:29.453192 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 38/74] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:30:28 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1408 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:30:29.835218 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-b4fc882f-fc1e-468a-96cd-e92f7bda33a0 req-c298707d-8659-47eb-972b-88f8f105f0dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b9038c8-1395-4d48-b10b-2fe7310c4c76", "tag": "920328ed-01fa-4ed4-b496-7b1fea54b54c"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:29.845537 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-b4fc882f-fc1e-468a-96cd-e92f7bda33a0 req-c298707d-8659-47eb-972b-88f8f105f0dd service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:29.846152 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-b4fc882f-fc1e-468a-96cd-e92f7bda33a0 req-c298707d-8659-47eb-972b-88f8f105f0dd service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:29.860450 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-b4fc882f-fc1e-468a-96cd-e92f7bda33a0 req-c298707d-8659-47eb-972b-88f8f105f0dd service nova] Creating event network-changed:920328ed-01fa-4ed4-b496-7b1fea54b54c for instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 on hv-cinder-84112 May 23 15:30:29.866377 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-b4fc882f-fc1e-468a-96cd-e92f7bda33a0 req-c298707d-8659-47eb-972b-88f8f105f0dd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.411489 May 23 15:30:29.867391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 39/75] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:30:29.878905 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d24ce75b-0b40-445c-9e07-42e6c5c8ac64 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:29.884197 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d24ce75b-0b40-445c-9e07-42e6c5c8ac64 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:29.900150 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d24ce75b-0b40-445c-9e07-42e6c5c8ac64 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:29.901300 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d24ce75b-0b40-445c-9e07-42e6c5c8ac64 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:29.907785 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d24ce75b-0b40-445c-9e07-42e6c5c8ac64 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:29.908330 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d24ce75b-0b40-445c-9e07-42e6c5c8ac64 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:29.913497 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=100 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:30.119912 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-bad8ba54-b415-4ce3-b448-1346846a543f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:30.141081 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-bad8ba54-b415-4ce3-b448-1346846a543f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1320 microversion: 2.1 time: 1.417352 May 23 15:30:30.145586 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 37/76] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:28 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1320 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:30.153102 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-e853d3ae-3ad6-460b-871c-d7f67d48eb9d req-bd1aec14-2d1e-4b78-ade2-3418fea5f66d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b766d9-7a6b-4d3a-8144-f23605dee4f9", "tag": "7a7ef05a-a7c7-40c6-8f33-1c4a2609e20c"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:30.178677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-e853d3ae-3ad6-460b-871c-d7f67d48eb9d req-bd1aec14-2d1e-4b78-ade2-3418fea5f66d service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:30.179135 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-e853d3ae-3ad6-460b-871c-d7f67d48eb9d req-bd1aec14-2d1e-4b78-ade2-3418fea5f66d service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:30.193741 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-e853d3ae-3ad6-460b-871c-d7f67d48eb9d req-bd1aec14-2d1e-4b78-ade2-3418fea5f66d service nova] Creating event network-changed:7a7ef05a-a7c7-40c6-8f33-1c4a2609e20c for instance c7b766d9-7a6b-4d3a-8144-f23605dee4f9 on hv-cinder-84112 May 23 15:30:30.201262 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-e853d3ae-3ad6-460b-871c-d7f67d48eb9d req-bd1aec14-2d1e-4b78-ade2-3418fea5f66d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057011 May 23 15:30:30.202765 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 38/77] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:30:30.211362 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-179d1a70-f610-41a3-9dc2-72aaf44a286d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:30.213616 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-179d1a70-f610-41a3-9dc2-72aaf44a286d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:30.229755 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-179d1a70-f610-41a3-9dc2-72aaf44a286d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:30.230979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-179d1a70-f610-41a3-9dc2-72aaf44a286d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:30.232460 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-179d1a70-f610-41a3-9dc2-72aaf44a286d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:30.233531 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-179d1a70-f610-41a3-9dc2-72aaf44a286d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:30.284495 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d24ce75b-0b40-445c-9e07-42e6c5c8ac64 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:30.300068 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d24ce75b-0b40-445c-9e07-42e6c5c8ac64 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1365 microversion: 2.1 time: 0.431065 May 23 15:30:30.301136 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 40/78] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:29 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1365 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:30.335758 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-14ca418f-08e4-4ae8-9f43-73750e5e803b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:30.336570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-14ca418f-08e4-4ae8-9f43-73750e5e803b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:30.356977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-14ca418f-08e4-4ae8-9f43-73750e5e803b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:30.357671 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-14ca418f-08e4-4ae8-9f43-73750e5e803b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:30.359125 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-14ca418f-08e4-4ae8-9f43-73750e5e803b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:30.362534 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-14ca418f-08e4-4ae8-9f43-73750e5e803b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:30.639890 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-179d1a70-f610-41a3-9dc2-72aaf44a286d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:30.648436 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-179d1a70-f610-41a3-9dc2-72aaf44a286d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1501 microversion: 2.1 time: 0.444287 May 23 15:30:30.662136 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 39/79] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:30 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1501 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:30.679596 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-14ca418f-08e4-4ae8-9f43-73750e5e803b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:30.689685 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-1c48af19-f493-491d-966c-a0df3ae1259c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:30.695163 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-1c48af19-f493-491d-966c-a0df3ae1259c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:30.700941 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-14ca418f-08e4-4ae8-9f43-73750e5e803b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1361 microversion: 2.1 time: 0.398352 May 23 15:30:30.703311 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 41/80] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:30 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1361 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:30.717631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1c48af19-f493-491d-966c-a0df3ae1259c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:30.719563 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1c48af19-f493-491d-966c-a0df3ae1259c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:30.721374 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1c48af19-f493-491d-966c-a0df3ae1259c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:30.722797 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1c48af19-f493-491d-966c-a0df3ae1259c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:30.791410 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=6 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:30.859682 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=28 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:31.162509 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-792b54cd-1913-40d7-bf72-54af606d84eb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:31.163858 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-792b54cd-1913-40d7-bf72-54af606d84eb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:31.183959 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-792b54cd-1913-40d7-bf72-54af606d84eb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:31.186209 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-792b54cd-1913-40d7-bf72-54af606d84eb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:31.188001 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-792b54cd-1913-40d7-bf72-54af606d84eb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:31.189554 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-792b54cd-1913-40d7-bf72-54af606d84eb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:31.440225 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=24 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:31.666950 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1c48af19-f493-491d-966c-a0df3ae1259c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:31.680641 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1c48af19-f493-491d-966c-a0df3ae1259c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:31.682600 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1c48af19-f493-491d-966c-a0df3ae1259c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:31.686771 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-1c48af19-f493-491d-966c-a0df3ae1259c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1408 microversion: 2.20 time: 1.021270 May 23 15:30:31.689059 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 40/81] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:30:30 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1408 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:30:31.710785 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-96fc3ea6-6705-4910-a399-ee7fd6e4027b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:31.712384 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-96fc3ea6-6705-4910-a399-ee7fd6e4027b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:31.727070 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96fc3ea6-6705-4910-a399-ee7fd6e4027b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:31.728502 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96fc3ea6-6705-4910-a399-ee7fd6e4027b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:31.734825 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96fc3ea6-6705-4910-a399-ee7fd6e4027b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:31.736293 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96fc3ea6-6705-4910-a399-ee7fd6e4027b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:31.768372 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=100 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:32.015860 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-792b54cd-1913-40d7-bf72-54af606d84eb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:32.026248 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-792b54cd-1913-40d7-bf72-54af606d84eb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1320 microversion: 2.1 time: 0.870368 May 23 15:30:32.027790 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 42/82] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:31 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1320 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:32.043685 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-14e4e193-b6f3-4f03-9ed3-f2d12393781f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:32.044441 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-14e4e193-b6f3-4f03-9ed3-f2d12393781f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:32.060355 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-14e4e193-b6f3-4f03-9ed3-f2d12393781f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:32.061744 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-14e4e193-b6f3-4f03-9ed3-f2d12393781f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:32.065984 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-14e4e193-b6f3-4f03-9ed3-f2d12393781f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:32.066834 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-14e4e193-b6f3-4f03-9ed3-f2d12393781f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:32.280943 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-96fc3ea6-6705-4910-a399-ee7fd6e4027b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:32.296333 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-96fc3ea6-6705-4910-a399-ee7fd6e4027b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1365 microversion: 2.1 time: 0.604704 May 23 15:30:32.296825 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 41/83] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:31 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1365 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:32.308475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-86d7a7f0-5180-4708-833b-94210b0f930c req-e018fc4f-ab96-406c-934f-e7e7552205e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40f940d7-a17e-4271-9326-70a868f80e59", "tag": "2e43ebd5-c351-461f-b27d-7ba1cfcd864a"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:32.329311 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-86d7a7f0-5180-4708-833b-94210b0f930c req-e018fc4f-ab96-406c-934f-e7e7552205e1 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:32.329756 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-86d7a7f0-5180-4708-833b-94210b0f930c req-e018fc4f-ab96-406c-934f-e7e7552205e1 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:32.352660 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-86d7a7f0-5180-4708-833b-94210b0f930c req-e018fc4f-ab96-406c-934f-e7e7552205e1 service nova] Creating event network-changed:2e43ebd5-c351-461f-b27d-7ba1cfcd864a for instance 40f940d7-a17e-4271-9326-70a868f80e59 on hv-cinder-84112 May 23 15:30:32.366773 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-86d7a7f0-5180-4708-833b-94210b0f930c req-e018fc4f-ab96-406c-934f-e7e7552205e1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068136 May 23 15:30:32.367385 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 42/84] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:30:32.374832 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-0f976aad-0a45-4c98-a268-c308df4c4843 req-9c78c273-7b29-4dfd-bf25-23adcd46f7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30f7223-50a4-46a7-b9df-cc24cc0ba14e", "tag": "844b0f3e-da49-4384-9cfa-321053312dea"}, {"name": "network-changed", "server_uuid": "9e1c71d3-9470-4f72-a76c-e6c114bd4821", "tag": "9beaf3ec-d7f6-4009-b3ff-01ff1bc11a9e"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:32.396541 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-0f976aad-0a45-4c98-a268-c308df4c4843 req-9c78c273-7b29-4dfd-bf25-23adcd46f7c9 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:32.396911 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-0f976aad-0a45-4c98-a268-c308df4c4843 req-9c78c273-7b29-4dfd-bf25-23adcd46f7c9 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:32.429674 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-0f976aad-0a45-4c98-a268-c308df4c4843 req-9c78c273-7b29-4dfd-bf25-23adcd46f7c9 service nova] Creating event network-changed:844b0f3e-da49-4384-9cfa-321053312dea for instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e on hv-cinder-84112 May 23 15:30:32.430072 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-0f976aad-0a45-4c98-a268-c308df4c4843 req-9c78c273-7b29-4dfd-bf25-23adcd46f7c9 service nova] Creating event network-changed:9beaf3ec-d7f6-4009-b3ff-01ff1bc11a9e for instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 on hv-cinder-84112 May 23 15:30:32.444118 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-0f976aad-0a45-4c98-a268-c308df4c4843 req-9c78c273-7b29-4dfd-bf25-23adcd46f7c9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.074136 May 23 15:30:32.445309 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 43/85] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:30:32.522949 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ec5a0469-f19d-4bb6-b4b4-0d2d15708388 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31153e06-c56c-4540-8a96-05b67d95bec9"}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:32.524138 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ec5a0469-f19d-4bb6-b4b4-0d2d15708388 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:32.539757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ec5a0469-f19d-4bb6-b4b4-0d2d15708388 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:32.540426 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ec5a0469-f19d-4bb6-b4b4-0d2d15708388 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:32.541387 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ec5a0469-f19d-4bb6-b4b4-0d2d15708388 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:32.541990 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ec5a0469-f19d-4bb6-b4b4-0d2d15708388 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:32.774915 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-14e4e193-b6f3-4f03-9ed3-f2d12393781f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:32.790003 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-14e4e193-b6f3-4f03-9ed3-f2d12393781f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1361 microversion: 2.1 time: 0.760121 May 23 15:30:32.792591 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 43/86] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:32 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1361 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:32.804854 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-65ccf3b2-409e-444a-9218-316a4c05c35a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:32.805449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-65ccf3b2-409e-444a-9218-316a4c05c35a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:32.818402 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-65ccf3b2-409e-444a-9218-316a4c05c35a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:32.819052 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-65ccf3b2-409e-444a-9218-316a4c05c35a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:32.820343 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-65ccf3b2-409e-444a-9218-316a4c05c35a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:32.821489 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-65ccf3b2-409e-444a-9218-316a4c05c35a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:33.533502 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ec5a0469-f19d-4bb6-b4b4-0d2d15708388 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "POST /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.014447 May 23 15:30:33.534128 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 44/87] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 15:30:32 2022] POST /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3/os-volume_attachments => generated 194 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:30:33.539483 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-65ccf3b2-409e-444a-9218-316a4c05c35a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:33.554658 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-65ccf3b2-409e-444a-9218-316a4c05c35a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:33.555410 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2972a46e-bb42-460e-bfa4-744a7593d60e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:33.556799 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-2972a46e-bb42-460e-bfa4-744a7593d60e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:33.566006 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-65ccf3b2-409e-444a-9218-316a4c05c35a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:33.567294 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-65ccf3b2-409e-444a-9218-316a4c05c35a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1408 microversion: 2.20 time: 0.772411 May 23 15:30:33.570973 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 44/88] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:30:32 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1408 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:30:33.572942 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2972a46e-bb42-460e-bfa4-744a7593d60e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:33.573406 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2972a46e-bb42-460e-bfa4-744a7593d60e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:33.575578 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2972a46e-bb42-460e-bfa4-744a7593d60e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:33.576022 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2972a46e-bb42-460e-bfa4-744a7593d60e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:33.585791 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c469e4a0-2279-409b-a96b-1f221321e9a3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:33.588204 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c469e4a0-2279-409b-a96b-1f221321e9a3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:33.596088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c469e4a0-2279-409b-a96b-1f221321e9a3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:33.596793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c469e4a0-2279-409b-a96b-1f221321e9a3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:33.597782 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c469e4a0-2279-409b-a96b-1f221321e9a3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:33.599009 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c469e4a0-2279-409b-a96b-1f221321e9a3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:34.019184 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c469e4a0-2279-409b-a96b-1f221321e9a3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:34.040040 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c469e4a0-2279-409b-a96b-1f221321e9a3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1365 microversion: 2.1 time: 0.465993 May 23 15:30:34.043662 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 45/89] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:33 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1365 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:34.055233 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-806f3416-fe52-4142-825b-4c39dc0fc760 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:34.055855 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-806f3416-fe52-4142-825b-4c39dc0fc760 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:34.083573 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-806f3416-fe52-4142-825b-4c39dc0fc760 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:34.084510 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-806f3416-fe52-4142-825b-4c39dc0fc760 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:34.089378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-806f3416-fe52-4142-825b-4c39dc0fc760 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:34.094758 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-806f3416-fe52-4142-825b-4c39dc0fc760 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:34.371668 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-806f3416-fe52-4142-825b-4c39dc0fc760 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:34.382836 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-806f3416-fe52-4142-825b-4c39dc0fc760 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1361 microversion: 2.1 time: 0.335186 May 23 15:30:34.383434 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 46/90] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:34 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1361 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:34.394501 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-1ac0422e-63c9-475c-b267-8dd0891832da req-7f0e7a0a-d148-41cd-acdd-efa77c55f938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9038c8-1395-4d48-b10b-2fe7310c4c76", "name": "network-vif-plugged", "status": "completed", "tag": "920328ed-01fa-4ed4-b496-7b1fea54b54c"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:34.436817 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-1ac0422e-63c9-475c-b267-8dd0891832da req-7f0e7a0a-d148-41cd-acdd-efa77c55f938 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:34.439572 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-1ac0422e-63c9-475c-b267-8dd0891832da req-7f0e7a0a-d148-41cd-acdd-efa77c55f938 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:34.446050 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-2972a46e-bb42-460e-bfa4-744a7593d60e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:34.458490 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-2972a46e-bb42-460e-bfa4-744a7593d60e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1320 microversion: 2.1 time: 0.915678 May 23 15:30:34.469905 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 45/91] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:33 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1320 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:34.470487 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-1ac0422e-63c9-475c-b267-8dd0891832da req-7f0e7a0a-d148-41cd-acdd-efa77c55f938 service nova] Creating event network-vif-plugged:920328ed-01fa-4ed4-b496-7b1fea54b54c for instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 on hv-cinder-84112 May 23 15:30:34.486318 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-1ac0422e-63c9-475c-b267-8dd0891832da req-7f0e7a0a-d148-41cd-acdd-efa77c55f938 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098505 May 23 15:30:34.486987 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 47/92] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:30:34.588980 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a8b6968e-cdc4-4f02-b3b1-d2eee1c7084a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:34.593678 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a8b6968e-cdc4-4f02-b3b1-d2eee1c7084a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:34.602839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a8b6968e-cdc4-4f02-b3b1-d2eee1c7084a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:34.603962 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a8b6968e-cdc4-4f02-b3b1-d2eee1c7084a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:34.604972 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a8b6968e-cdc4-4f02-b3b1-d2eee1c7084a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:34.605882 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a8b6968e-cdc4-4f02-b3b1-d2eee1c7084a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:34.868240 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a8b6968e-cdc4-4f02-b3b1-d2eee1c7084a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:34.887506 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a8b6968e-cdc4-4f02-b3b1-d2eee1c7084a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:34.892271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a8b6968e-cdc4-4f02-b3b1-d2eee1c7084a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:34.894256 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a8b6968e-cdc4-4f02-b3b1-d2eee1c7084a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1408 microversion: 2.20 time: 0.311964 May 23 15:30:34.897968 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 46/93] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:30:34 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1408 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:30:35.060518 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-761ccb5d-d2aa-476d-a555-573a47a5eff3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:35.061416 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-761ccb5d-d2aa-476d-a555-573a47a5eff3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:35.071032 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-761ccb5d-d2aa-476d-a555-573a47a5eff3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:35.071486 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-761ccb5d-d2aa-476d-a555-573a47a5eff3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:35.072265 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-761ccb5d-d2aa-476d-a555-573a47a5eff3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:35.072711 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-761ccb5d-d2aa-476d-a555-573a47a5eff3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:35.263438 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-761ccb5d-d2aa-476d-a555-573a47a5eff3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:35.274138 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-761ccb5d-d2aa-476d-a555-573a47a5eff3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1365 microversion: 2.1 time: 0.218458 May 23 15:30:35.275336 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 48/94] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:35 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:35.400659 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-0282c904-046c-4838-85cb-128f0904592c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:35.401897 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-0282c904-046c-4838-85cb-128f0904592c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:35.411781 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0282c904-046c-4838-85cb-128f0904592c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:35.412243 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0282c904-046c-4838-85cb-128f0904592c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:35.413498 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0282c904-046c-4838-85cb-128f0904592c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:35.414193 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0282c904-046c-4838-85cb-128f0904592c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:35.486660 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-4ad7c11e-27cf-4833-ae6e-8249d9f2903a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:35.487356 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-4ad7c11e-27cf-4833-ae6e-8249d9f2903a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:35.498609 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4ad7c11e-27cf-4833-ae6e-8249d9f2903a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:35.499377 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4ad7c11e-27cf-4833-ae6e-8249d9f2903a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:35.500501 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4ad7c11e-27cf-4833-ae6e-8249d9f2903a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:35.501194 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4ad7c11e-27cf-4833-ae6e-8249d9f2903a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:35.665391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=8 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:35.702874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0282c904-046c-4838-85cb-128f0904592c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:35.713661 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-0282c904-046c-4838-85cb-128f0904592c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1361 microversion: 2.1 time: 0.317125 May 23 15:30:35.714445 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 47/95] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:35 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1361 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:35.761983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-4ad7c11e-27cf-4833-ae6e-8249d9f2903a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:35.776921 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-4ad7c11e-27cf-4833-ae6e-8249d9f2903a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1320 microversion: 2.1 time: 0.293948 May 23 15:30:35.778024 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 49/96] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:35 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1320 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:35.927353 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-7108885a-af11-485b-9fa7-1e303b7e9212 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:35.927829 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-7108885a-af11-485b-9fa7-1e303b7e9212 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:35.941645 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7108885a-af11-485b-9fa7-1e303b7e9212 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:35.942744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7108885a-af11-485b-9fa7-1e303b7e9212 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:35.946045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7108885a-af11-485b-9fa7-1e303b7e9212 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:35.947598 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7108885a-af11-485b-9fa7-1e303b7e9212 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:36.264268 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-7108885a-af11-485b-9fa7-1e303b7e9212 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:36.294070 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-dc4e6dc9-4f69-4062-b1e1-45e09880bdfe tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:36.294602 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-dc4e6dc9-4f69-4062-b1e1-45e09880bdfe tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:36.298318 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-7108885a-af11-485b-9fa7-1e303b7e9212 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:36.301347 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-7108885a-af11-485b-9fa7-1e303b7e9212 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:36.302770 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-7108885a-af11-485b-9fa7-1e303b7e9212 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1408 microversion: 2.20 time: 0.387355 May 23 15:30:36.304440 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 48/97] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:30:35 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1408 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:30:36.309001 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-dc4e6dc9-4f69-4062-b1e1-45e09880bdfe tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:36.309949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-dc4e6dc9-4f69-4062-b1e1-45e09880bdfe tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:36.311333 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-dc4e6dc9-4f69-4062-b1e1-45e09880bdfe tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:36.311980 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-dc4e6dc9-4f69-4062-b1e1-45e09880bdfe tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:36.594945 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-dc4e6dc9-4f69-4062-b1e1-45e09880bdfe tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:36.637214 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-dc4e6dc9-4f69-4062-b1e1-45e09880bdfe tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1365 microversion: 2.1 time: 0.344741 May 23 15:30:36.644565 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 50/98] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:36 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:36.732168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5ee5c26f-27f5-4f98-a327-b2f849cbd9bf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:36.732798 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-5ee5c26f-27f5-4f98-a327-b2f849cbd9bf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:36.752514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5ee5c26f-27f5-4f98-a327-b2f849cbd9bf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:36.753351 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5ee5c26f-27f5-4f98-a327-b2f849cbd9bf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:36.757185 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5ee5c26f-27f5-4f98-a327-b2f849cbd9bf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:36.757996 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5ee5c26f-27f5-4f98-a327-b2f849cbd9bf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:36.798907 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3bda8fae-3d9b-498b-b845-fbe4b4d9d8f7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:36.799695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-3bda8fae-3d9b-498b-b845-fbe4b4d9d8f7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:36.819373 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:36.827284 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3bda8fae-3d9b-498b-b845-fbe4b4d9d8f7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:36.829392 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3bda8fae-3d9b-498b-b845-fbe4b4d9d8f7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:36.830371 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3bda8fae-3d9b-498b-b845-fbe4b4d9d8f7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:36.831466 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3bda8fae-3d9b-498b-b845-fbe4b4d9d8f7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:37.350266 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3bda8fae-3d9b-498b-b845-fbe4b4d9d8f7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:37.364065 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-3bda8fae-3d9b-498b-b845-fbe4b4d9d8f7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1320 microversion: 2.1 time: 0.570880 May 23 15:30:37.376135 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 51/99] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:36 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1320 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:37.388294 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-29c976ab-1582-4230-97f4-57ebcb5092dd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:37.389947 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-29c976ab-1582-4230-97f4-57ebcb5092dd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:37.403090 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-5ee5c26f-27f5-4f98-a327-b2f849cbd9bf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:37.406147 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-29c976ab-1582-4230-97f4-57ebcb5092dd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:37.411478 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5ee5c26f-27f5-4f98-a327-b2f849cbd9bf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1361 microversion: 2.1 time: 0.683870 May 23 15:30:37.411769 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-29c976ab-1582-4230-97f4-57ebcb5092dd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:37.412859 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-29c976ab-1582-4230-97f4-57ebcb5092dd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:37.413488 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-29c976ab-1582-4230-97f4-57ebcb5092dd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:37.415288 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 49/100] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:36 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1361 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:37.670802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-478337ce-3f86-4f04-9e99-8b99c27d9aa4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:37.671923 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-478337ce-3f86-4f04-9e99-8b99c27d9aa4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:37.688295 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-478337ce-3f86-4f04-9e99-8b99c27d9aa4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:37.690485 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-478337ce-3f86-4f04-9e99-8b99c27d9aa4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:37.695513 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-29c976ab-1582-4230-97f4-57ebcb5092dd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:37.699655 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-478337ce-3f86-4f04-9e99-8b99c27d9aa4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:37.705933 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-29c976ab-1582-4230-97f4-57ebcb5092dd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:37.706389 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-478337ce-3f86-4f04-9e99-8b99c27d9aa4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:37.708151 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-29c976ab-1582-4230-97f4-57ebcb5092dd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:37.709483 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-29c976ab-1582-4230-97f4-57ebcb5092dd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1408 microversion: 2.20 time: 0.332101 May 23 15:30:37.720460 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 52/101] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:30:37 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1408 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:30:38.054907 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-478337ce-3f86-4f04-9e99-8b99c27d9aa4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:38.065288 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-478337ce-3f86-4f04-9e99-8b99c27d9aa4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1365 microversion: 2.1 time: 0.407123 May 23 15:30:38.066387 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 50/102] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:37 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1365 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:38.385561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-e03c7687-3bc0-4233-8138-4d7255d23dca tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:38.388322 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-e03c7687-3bc0-4233-8138-4d7255d23dca tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:38.395348 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e03c7687-3bc0-4233-8138-4d7255d23dca tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:38.396326 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e03c7687-3bc0-4233-8138-4d7255d23dca tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:38.397873 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e03c7687-3bc0-4233-8138-4d7255d23dca tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:38.405083 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e03c7687-3bc0-4233-8138-4d7255d23dca tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:38.431290 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-6154f410-a8ca-44bf-a4ab-067926eb5236 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:38.433492 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-6154f410-a8ca-44bf-a4ab-067926eb5236 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:38.444840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6154f410-a8ca-44bf-a4ab-067926eb5236 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:38.447208 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6154f410-a8ca-44bf-a4ab-067926eb5236 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:38.448333 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6154f410-a8ca-44bf-a4ab-067926eb5236 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:38.450152 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6154f410-a8ca-44bf-a4ab-067926eb5236 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:38.912919 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-e03c7687-3bc0-4233-8138-4d7255d23dca tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:38.924890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-e03c7687-3bc0-4233-8138-4d7255d23dca tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1320 microversion: 2.1 time: 0.545316 May 23 15:30:38.926025 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 53/103] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:38 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1320 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:38.931357 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c35ffc30-0ea8-438a-adbd-38947f50ba77 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:38.932157 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c35ffc30-0ea8-438a-adbd-38947f50ba77 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:38.942812 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c35ffc30-0ea8-438a-adbd-38947f50ba77 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:38.943497 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c35ffc30-0ea8-438a-adbd-38947f50ba77 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:38.944602 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c35ffc30-0ea8-438a-adbd-38947f50ba77 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:38.945236 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c35ffc30-0ea8-438a-adbd-38947f50ba77 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:39.078412 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-6154f410-a8ca-44bf-a4ab-067926eb5236 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:39.093429 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-6154f410-a8ca-44bf-a4ab-067926eb5236 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1361 microversion: 2.1 time: 0.663762 May 23 15:30:39.094301 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 51/104] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:38 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1361 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:39.113748 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-54b9e015-3356-42dc-9eb5-885c5376a2ac tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:39.114635 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-54b9e015-3356-42dc-9eb5-885c5376a2ac tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:39.130016 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-54b9e015-3356-42dc-9eb5-885c5376a2ac tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:39.130712 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-54b9e015-3356-42dc-9eb5-885c5376a2ac tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:39.132789 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-54b9e015-3356-42dc-9eb5-885c5376a2ac tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:39.137106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-54b9e015-3356-42dc-9eb5-885c5376a2ac tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:39.260046 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c35ffc30-0ea8-438a-adbd-38947f50ba77 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:39.273396 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c35ffc30-0ea8-438a-adbd-38947f50ba77 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:39.281183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c35ffc30-0ea8-438a-adbd-38947f50ba77 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:39.282366 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c35ffc30-0ea8-438a-adbd-38947f50ba77 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1408 microversion: 2.20 time: 0.355254 May 23 15:30:39.282954 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 54/105] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:30:38 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1408 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:30:39.647946 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-54b9e015-3356-42dc-9eb5-885c5376a2ac tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:39.665949 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-54b9e015-3356-42dc-9eb5-885c5376a2ac tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1365 microversion: 2.1 time: 0.562322 May 23 15:30:39.666821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 52/106] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:39 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1365 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:39.719303 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-f6c8aed8-f84d-4b60-80ba-091fe6cdc67a req-338879b0-46b6-4298-aced-65eaf6768e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f940d7-a17e-4271-9326-70a868f80e59", "name": "network-vif-plugged", "status": "completed", "tag": "2e43ebd5-c351-461f-b27d-7ba1cfcd864a"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:39.734345 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-f6c8aed8-f84d-4b60-80ba-091fe6cdc67a req-338879b0-46b6-4298-aced-65eaf6768e30 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:39.737351 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-f6c8aed8-f84d-4b60-80ba-091fe6cdc67a req-338879b0-46b6-4298-aced-65eaf6768e30 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:39.762085 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-f6c8aed8-f84d-4b60-80ba-091fe6cdc67a req-338879b0-46b6-4298-aced-65eaf6768e30 service nova] Creating event network-vif-plugged:2e43ebd5-c351-461f-b27d-7ba1cfcd864a for instance 40f940d7-a17e-4271-9326-70a868f80e59 on hv-cinder-84112 May 23 15:30:39.769599 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-f6c8aed8-f84d-4b60-80ba-091fe6cdc67a req-338879b0-46b6-4298-aced-65eaf6768e30 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055212 May 23 15:30:39.772226 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 55/107] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:30:39.945460 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-66818913-b755-443e-8952-b06bd6a9802f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:39.946348 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-66818913-b755-443e-8952-b06bd6a9802f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:39.971516 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-66818913-b755-443e-8952-b06bd6a9802f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:39.972257 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-66818913-b755-443e-8952-b06bd6a9802f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:39.973312 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-66818913-b755-443e-8952-b06bd6a9802f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:39.973782 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-66818913-b755-443e-8952-b06bd6a9802f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:40.113524 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7483be5d-ed7c-4567-8809-fd99b2dc45a2 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:40.114522 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7483be5d-ed7c-4567-8809-fd99b2dc45a2 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:40.127634 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7483be5d-ed7c-4567-8809-fd99b2dc45a2 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:40.129503 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7483be5d-ed7c-4567-8809-fd99b2dc45a2 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:40.132192 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7483be5d-ed7c-4567-8809-fd99b2dc45a2 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:40.133155 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7483be5d-ed7c-4567-8809-fd99b2dc45a2 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:40.569883 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-66818913-b755-443e-8952-b06bd6a9802f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:40.584833 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-66818913-b755-443e-8952-b06bd6a9802f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1320 microversion: 2.1 time: 0.645260 May 23 15:30:40.595054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 53/108] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:39 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1320 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:40.597722 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-9f98b10c-ea85-43f6-8b25-673bc68ea213 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:40.599527 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-9f98b10c-ea85-43f6-8b25-673bc68ea213 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:40.610318 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:40.617518 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9f98b10c-ea85-43f6-8b25-673bc68ea213 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:40.618298 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9f98b10c-ea85-43f6-8b25-673bc68ea213 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:40.619292 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9f98b10c-ea85-43f6-8b25-673bc68ea213 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:40.620043 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9f98b10c-ea85-43f6-8b25-673bc68ea213 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:40.666188 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-7483be5d-ed7c-4567-8809-fd99b2dc45a2 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:40.685817 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7483be5d-ed7c-4567-8809-fd99b2dc45a2 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1361 microversion: 2.1 time: 0.577849 May 23 15:30:40.687029 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 56/109] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:40 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1361 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:40.695950 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-45c8dfb0-2f4a-446b-be77-88b6a128caa3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:40.697101 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-45c8dfb0-2f4a-446b-be77-88b6a128caa3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:40.705145 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-45c8dfb0-2f4a-446b-be77-88b6a128caa3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:40.705915 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-45c8dfb0-2f4a-446b-be77-88b6a128caa3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:40.706943 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-45c8dfb0-2f4a-446b-be77-88b6a128caa3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:40.708949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-45c8dfb0-2f4a-446b-be77-88b6a128caa3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:40.832071 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9f98b10c-ea85-43f6-8b25-673bc68ea213 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:40.844028 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9f98b10c-ea85-43f6-8b25-673bc68ea213 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:40.848790 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9f98b10c-ea85-43f6-8b25-673bc68ea213 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:40.852857 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-9f98b10c-ea85-43f6-8b25-673bc68ea213 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1599 microversion: 2.20 time: 0.256388 May 23 15:30:40.853654 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 54/110] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:30:40 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1599 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:30:40.875170 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8cc950ef-8647-4551-a1d1-6b74ad067464 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:40.876170 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8cc950ef-8647-4551-a1d1-6b74ad067464 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:40.912375 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8cc950ef-8647-4551-a1d1-6b74ad067464 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:40.914259 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8cc950ef-8647-4551-a1d1-6b74ad067464 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:40.927343 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8cc950ef-8647-4551-a1d1-6b74ad067464 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:40.928026 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8cc950ef-8647-4551-a1d1-6b74ad067464 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:41.068339 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8cc950ef-8647-4551-a1d1-6b74ad067464 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.197626 May 23 15:30:41.069422 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 55/111] 10.222.0.30 () {60 vars in 1315 bytes} [Mon May 23 15:30:40 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-interface => generated 284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:30:41.144771 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-45c8dfb0-2f4a-446b-be77-88b6a128caa3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:41.160033 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-45c8dfb0-2f4a-446b-be77-88b6a128caa3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1365 microversion: 2.1 time: 0.471591 May 23 15:30:41.162354 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 57/112] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:40 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1365 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:41.602480 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ce91dc5a-08ed-4ec9-b612-f4692e599778 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:41.605999 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ce91dc5a-08ed-4ec9-b612-f4692e599778 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:41.662633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ce91dc5a-08ed-4ec9-b612-f4692e599778 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:41.663107 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ce91dc5a-08ed-4ec9-b612-f4692e599778 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:41.675006 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ce91dc5a-08ed-4ec9-b612-f4692e599778 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:41.694225 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ce91dc5a-08ed-4ec9-b612-f4692e599778 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:41.712980 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5a8299af-5c4e-4306-a85a-1fc4fe37656c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:41.713839 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-5a8299af-5c4e-4306-a85a-1fc4fe37656c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:41.731480 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5a8299af-5c4e-4306-a85a-1fc4fe37656c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:41.733388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5a8299af-5c4e-4306-a85a-1fc4fe37656c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:41.734830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5a8299af-5c4e-4306-a85a-1fc4fe37656c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:41.736568 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5a8299af-5c4e-4306-a85a-1fc4fe37656c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:41.750652 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=100 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:42.063437 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-5a8299af-5c4e-4306-a85a-1fc4fe37656c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:42.077925 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-5a8299af-5c4e-4306-a85a-1fc4fe37656c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1361 microversion: 2.1 time: 0.378270 May 23 15:30:42.082065 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 58/113] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:41 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1361 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:42.092913 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-d5343b27-1704-4657-827b-81fcb10c7b77 req-4c38892d-4407-4c63-88b6-dcd5f0b2da62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b766d9-7a6b-4d3a-8144-f23605dee4f9", "name": "network-vif-plugged", "status": "completed", "tag": "7a7ef05a-a7c7-40c6-8f33-1c4a2609e20c"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:42.113864 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-d5343b27-1704-4657-827b-81fcb10c7b77 req-4c38892d-4407-4c63-88b6-dcd5f0b2da62 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:42.114566 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-d5343b27-1704-4657-827b-81fcb10c7b77 req-4c38892d-4407-4c63-88b6-dcd5f0b2da62 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:42.130943 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-d5343b27-1704-4657-827b-81fcb10c7b77 req-4c38892d-4407-4c63-88b6-dcd5f0b2da62 service nova] Creating event network-vif-plugged:7a7ef05a-a7c7-40c6-8f33-1c4a2609e20c for instance c7b766d9-7a6b-4d3a-8144-f23605dee4f9 on hv-cinder-84112 May 23 15:30:42.136928 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-d5343b27-1704-4657-827b-81fcb10c7b77 req-4c38892d-4407-4c63-88b6-dcd5f0b2da62 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053424 May 23 15:30:42.138187 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 59/114] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:30:42.185741 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-180ed8b7-e836-457a-88e0-5ea1c0508c0a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:42.187712 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-180ed8b7-e836-457a-88e0-5ea1c0508c0a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:42.196358 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-180ed8b7-e836-457a-88e0-5ea1c0508c0a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:42.198032 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-180ed8b7-e836-457a-88e0-5ea1c0508c0a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:42.200173 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-180ed8b7-e836-457a-88e0-5ea1c0508c0a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:42.201172 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-180ed8b7-e836-457a-88e0-5ea1c0508c0a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:42.240498 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ce91dc5a-08ed-4ec9-b612-f4692e599778 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:42.259587 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ce91dc5a-08ed-4ec9-b612-f4692e599778 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1320 microversion: 2.1 time: 0.660928 May 23 15:30:42.260182 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 56/115] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:41 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1320 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:42.431820 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-180ed8b7-e836-457a-88e0-5ea1c0508c0a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:42.447883 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-180ed8b7-e836-457a-88e0-5ea1c0508c0a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1365 microversion: 2.1 time: 0.271336 May 23 15:30:42.449388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 60/116] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:42 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:43.096711 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-1e6acd69-de4c-4ac1-a122-cb92070e8a31 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:43.097861 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-1e6acd69-de4c-4ac1-a122-cb92070e8a31 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:43.107227 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1e6acd69-de4c-4ac1-a122-cb92070e8a31 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:43.110004 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1e6acd69-de4c-4ac1-a122-cb92070e8a31 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:43.112947 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1e6acd69-de4c-4ac1-a122-cb92070e8a31 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:43.114292 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1e6acd69-de4c-4ac1-a122-cb92070e8a31 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:43.277419 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1dbf3365-31a7-4db8-8ace-1aa88114a221 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:43.281020 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-1dbf3365-31a7-4db8-8ace-1aa88114a221 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:43.300899 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1dbf3365-31a7-4db8-8ace-1aa88114a221 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:43.306102 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1dbf3365-31a7-4db8-8ace-1aa88114a221 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:43.312279 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1dbf3365-31a7-4db8-8ace-1aa88114a221 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:43.315499 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1dbf3365-31a7-4db8-8ace-1aa88114a221 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:43.649407 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1e6acd69-de4c-4ac1-a122-cb92070e8a31 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:43.663319 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-1e6acd69-de4c-4ac1-a122-cb92070e8a31 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1361 microversion: 2.1 time: 0.571147 May 23 15:30:43.664482 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 57/117] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:43 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1361 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:43.674772 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d7b0114c-8d84-4116-97aa-6bdfc6d9cb62 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:43.677872 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d7b0114c-8d84-4116-97aa-6bdfc6d9cb62 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:43.695755 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d7b0114c-8d84-4116-97aa-6bdfc6d9cb62 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:43.696443 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d7b0114c-8d84-4116-97aa-6bdfc6d9cb62 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:43.697551 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d7b0114c-8d84-4116-97aa-6bdfc6d9cb62 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:43.698089 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d7b0114c-8d84-4116-97aa-6bdfc6d9cb62 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:43.745284 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:44.023077 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d7b0114c-8d84-4116-97aa-6bdfc6d9cb62 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:44.033587 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d7b0114c-8d84-4116-97aa-6bdfc6d9cb62 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1365 microversion: 2.1 time: 0.367854 May 23 15:30:44.034274 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 58/118] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:43 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1365 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:44.039112 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-1dbf3365-31a7-4db8-8ace-1aa88114a221 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:44.054480 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1dbf3365-31a7-4db8-8ace-1aa88114a221 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1320 microversion: 2.1 time: 0.780979 May 23 15:30:44.055386 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 61/119] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:43 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1320 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:44.157997 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-a5225800-da41-4529-89fb-4549ef6e6266 req-e8e03d50-eef5-40c7-aa93-d4f0671fae37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30f7223-50a4-46a7-b9df-cc24cc0ba14e", "name": "network-vif-plugged", "status": "completed", "tag": "844b0f3e-da49-4384-9cfa-321053312dea"}, {"server_uuid": "9e1c71d3-9470-4f72-a76c-e6c114bd4821", "name": "network-vif-plugged", "status": "completed", "tag": "9beaf3ec-d7f6-4009-b3ff-01ff1bc11a9e"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:44.172137 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-a5225800-da41-4529-89fb-4549ef6e6266 req-e8e03d50-eef5-40c7-aa93-d4f0671fae37 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:44.172785 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-a5225800-da41-4529-89fb-4549ef6e6266 req-e8e03d50-eef5-40c7-aa93-d4f0671fae37 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:44.191070 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-a5225800-da41-4529-89fb-4549ef6e6266 req-e8e03d50-eef5-40c7-aa93-d4f0671fae37 service nova] Creating event network-vif-plugged:844b0f3e-da49-4384-9cfa-321053312dea for instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e on hv-cinder-84112 May 23 15:30:44.191585 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-a5225800-da41-4529-89fb-4549ef6e6266 req-e8e03d50-eef5-40c7-aa93-d4f0671fae37 service nova] Creating event network-vif-plugged:9beaf3ec-d7f6-4009-b3ff-01ff1bc11a9e for instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 on hv-cinder-84112 May 23 15:30:44.202620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-a5225800-da41-4529-89fb-4549ef6e6266 req-e8e03d50-eef5-40c7-aa93-d4f0671fae37 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048138 May 23 15:30:44.203838 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 59/120] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:30:44.305646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-f97034dd-b8fd-4bc0-9809-983e56942a6d req-bc38ad74-7362-41fa-becc-38fb600211b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b9038c8-1395-4d48-b10b-2fe7310c4c76", "tag": "920328ed-01fa-4ed4-b496-7b1fea54b54c"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:44.315542 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-f97034dd-b8fd-4bc0-9809-983e56942a6d req-bc38ad74-7362-41fa-becc-38fb600211b4 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:44.316314 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-f97034dd-b8fd-4bc0-9809-983e56942a6d req-bc38ad74-7362-41fa-becc-38fb600211b4 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:44.329506 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-f97034dd-b8fd-4bc0-9809-983e56942a6d req-bc38ad74-7362-41fa-becc-38fb600211b4 service nova] Creating event network-changed:920328ed-01fa-4ed4-b496-7b1fea54b54c for instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 on hv-cinder-84112 May 23 15:30:44.334582 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-f97034dd-b8fd-4bc0-9809-983e56942a6d req-bc38ad74-7362-41fa-becc-38fb600211b4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032973 May 23 15:30:44.335295 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 62/121] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:30:44.680767 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b01b668d-3c59-48fc-94ca-6150c16c3a09 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:44.681703 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b01b668d-3c59-48fc-94ca-6150c16c3a09 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:44.690736 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b01b668d-3c59-48fc-94ca-6150c16c3a09 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:44.693495 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b01b668d-3c59-48fc-94ca-6150c16c3a09 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:44.695601 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b01b668d-3c59-48fc-94ca-6150c16c3a09 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:44.696390 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b01b668d-3c59-48fc-94ca-6150c16c3a09 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:44.958661 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b01b668d-3c59-48fc-94ca-6150c16c3a09 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:44.972594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b01b668d-3c59-48fc-94ca-6150c16c3a09 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1361 microversion: 2.1 time: 0.295092 May 23 15:30:44.974459 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 60/122] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:44 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1361 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:45.059843 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-320f1e2a-cda9-4082-802b-5a8718d6d8ef tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:45.060885 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-320f1e2a-cda9-4082-802b-5a8718d6d8ef tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:45.070943 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-320f1e2a-cda9-4082-802b-5a8718d6d8ef tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:45.071873 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-320f1e2a-cda9-4082-802b-5a8718d6d8ef tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:45.073261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-0dcd2445-a37b-4f77-9381-349121d14b82 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:45.074831 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-0dcd2445-a37b-4f77-9381-349121d14b82 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:45.075683 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-320f1e2a-cda9-4082-802b-5a8718d6d8ef tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:45.076336 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-320f1e2a-cda9-4082-802b-5a8718d6d8ef tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:45.091901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0dcd2445-a37b-4f77-9381-349121d14b82 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:45.092886 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0dcd2445-a37b-4f77-9381-349121d14b82 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:45.099284 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0dcd2445-a37b-4f77-9381-349121d14b82 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:45.101692 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0dcd2445-a37b-4f77-9381-349121d14b82 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:45.430700 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-320f1e2a-cda9-4082-802b-5a8718d6d8ef tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:45.440380 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-320f1e2a-cda9-4082-802b-5a8718d6d8ef tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1365 microversion: 2.1 time: 0.392362 May 23 15:30:45.442149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 63/123] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:45 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1365 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:45.458217 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0dcd2445-a37b-4f77-9381-349121d14b82 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:45.470102 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-0dcd2445-a37b-4f77-9381-349121d14b82 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1320 microversion: 2.1 time: 0.402308 May 23 15:30:45.474402 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 61/124] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:45 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1320 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:45.992005 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ebe6aaf3-e5a6-4591-a600-b9a9cdc6a894 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:45.992638 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ebe6aaf3-e5a6-4591-a600-b9a9cdc6a894 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:45.999896 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ebe6aaf3-e5a6-4591-a600-b9a9cdc6a894 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:46.000349 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ebe6aaf3-e5a6-4591-a600-b9a9cdc6a894 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:46.001170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ebe6aaf3-e5a6-4591-a600-b9a9cdc6a894 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:46.001817 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ebe6aaf3-e5a6-4591-a600-b9a9cdc6a894 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:46.148924 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ebe6aaf3-e5a6-4591-a600-b9a9cdc6a894 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:46.157252 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ebe6aaf3-e5a6-4591-a600-b9a9cdc6a894 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1361 microversion: 2.1 time: 0.169689 May 23 15:30:46.158160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 64/125] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:45 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:46.461441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-262f8560-518e-48ca-b5a5-d05ead0a5efb tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:46.462537 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-262f8560-518e-48ca-b5a5-d05ead0a5efb tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:46.472330 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-262f8560-518e-48ca-b5a5-d05ead0a5efb tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:46.473158 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-262f8560-518e-48ca-b5a5-d05ead0a5efb tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:46.474539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-262f8560-518e-48ca-b5a5-d05ead0a5efb tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:46.475181 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-262f8560-518e-48ca-b5a5-d05ead0a5efb tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:46.487661 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b4a97c79-8548-4e73-b602-7ef3f064290a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:46.489070 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b4a97c79-8548-4e73-b602-7ef3f064290a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:46.500567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b4a97c79-8548-4e73-b602-7ef3f064290a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:46.502539 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b4a97c79-8548-4e73-b602-7ef3f064290a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:46.503757 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b4a97c79-8548-4e73-b602-7ef3f064290a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:46.509144 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b4a97c79-8548-4e73-b602-7ef3f064290a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:46.764816 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b4a97c79-8548-4e73-b602-7ef3f064290a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:46.778181 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b4a97c79-8548-4e73-b602-7ef3f064290a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1515 microversion: 2.1 time: 0.294852 May 23 15:30:46.779587 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 65/126] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:46 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1515 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:46.797672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-4fec22cf-f57d-40a2-acc6-853c1dfc49a7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:46.799778 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-4fec22cf-f57d-40a2-acc6-853c1dfc49a7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:46.808319 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4fec22cf-f57d-40a2-acc6-853c1dfc49a7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:46.809430 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4fec22cf-f57d-40a2-acc6-853c1dfc49a7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:46.810783 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4fec22cf-f57d-40a2-acc6-853c1dfc49a7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:46.811715 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4fec22cf-f57d-40a2-acc6-853c1dfc49a7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:46.890268 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.objects.instance [None req-4fec22cf-f57d-40a2-acc6-853c1dfc49a7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lazy-loading 'flavor' on Instance uuid c7b766d9-7a6b-4d3a-8144-f23605dee4f9 {{(pid=117973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:30:47.090594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-262f8560-518e-48ca-b5a5-d05ead0a5efb tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:47.104237 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-262f8560-518e-48ca-b5a5-d05ead0a5efb tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1365 microversion: 2.1 time: 0.648981 May 23 15:30:47.105933 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 62/127] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:46 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1365 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:47.176054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-304bf528-04c4-4252-9fda-3dc0016bdb6b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:47.176719 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-304bf528-04c4-4252-9fda-3dc0016bdb6b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:47.188377 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-304bf528-04c4-4252-9fda-3dc0016bdb6b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:47.189123 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-304bf528-04c4-4252-9fda-3dc0016bdb6b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:47.190184 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-304bf528-04c4-4252-9fda-3dc0016bdb6b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:47.191179 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-304bf528-04c4-4252-9fda-3dc0016bdb6b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:47.203074 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-4fec22cf-f57d-40a2-acc6-853c1dfc49a7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "POST /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9/action" status: 200 len: 32 microversion: 2.1 time: 0.411147 May 23 15:30:47.204112 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 66/128] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 15:30:46 2022] POST /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9/action => generated 32 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 23 15:30:47.215186 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-58233b33-1e9f-4122-8a5f-e1f576132b91 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:47.216047 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-58233b33-1e9f-4122-8a5f-e1f576132b91 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:47.225587 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58233b33-1e9f-4122-8a5f-e1f576132b91 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:47.226206 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58233b33-1e9f-4122-8a5f-e1f576132b91 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:47.227054 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58233b33-1e9f-4122-8a5f-e1f576132b91 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:47.227685 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58233b33-1e9f-4122-8a5f-e1f576132b91 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:47.343145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-304bf528-04c4-4252-9fda-3dc0016bdb6b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:47.359931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-304bf528-04c4-4252-9fda-3dc0016bdb6b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1361 microversion: 2.1 time: 0.187023 May 23 15:30:47.360939 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 63/129] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:47 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:47.534556 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-58233b33-1e9f-4122-8a5f-e1f576132b91 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:47.545313 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-58233b33-1e9f-4122-8a5f-e1f576132b91 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.336283 May 23 15:30:47.546087 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 67/130] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:47 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:48.122869 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d4ee30c7-2a49-4df3-b345-8c321cd39231 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:48.124017 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d4ee30c7-2a49-4df3-b345-8c321cd39231 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:48.131305 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d4ee30c7-2a49-4df3-b345-8c321cd39231 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:48.131812 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d4ee30c7-2a49-4df3-b345-8c321cd39231 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:48.132976 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d4ee30c7-2a49-4df3-b345-8c321cd39231 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:48.133448 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d4ee30c7-2a49-4df3-b345-8c321cd39231 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:48.322482 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d4ee30c7-2a49-4df3-b345-8c321cd39231 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:48.331481 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d4ee30c7-2a49-4df3-b345-8c321cd39231 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1365 microversion: 2.1 time: 0.212339 May 23 15:30:48.341173 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 64/131] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:48 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:48.378795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5647c81b-6e09-421d-9b36-e2def52943ff tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:48.379352 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-5647c81b-6e09-421d-9b36-e2def52943ff tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:48.386185 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5647c81b-6e09-421d-9b36-e2def52943ff tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:48.386844 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5647c81b-6e09-421d-9b36-e2def52943ff tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:48.387682 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5647c81b-6e09-421d-9b36-e2def52943ff tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:48.388187 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5647c81b-6e09-421d-9b36-e2def52943ff tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:48.563305 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-56de8223-be5e-4b53-b328-6dfc81299a96 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:48.564224 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-56de8223-be5e-4b53-b328-6dfc81299a96 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:48.568449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-5647c81b-6e09-421d-9b36-e2def52943ff tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:48.582633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-56de8223-be5e-4b53-b328-6dfc81299a96 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:48.583648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-5647c81b-6e09-421d-9b36-e2def52943ff tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1361 microversion: 2.1 time: 0.209839 May 23 15:30:48.584468 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 68/132] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:48 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:48.585415 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-56de8223-be5e-4b53-b328-6dfc81299a96 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:48.593663 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-56de8223-be5e-4b53-b328-6dfc81299a96 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:48.594289 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-56de8223-be5e-4b53-b328-6dfc81299a96 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:48.763216 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-56de8223-be5e-4b53-b328-6dfc81299a96 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:48.771366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-56de8223-be5e-4b53-b328-6dfc81299a96 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.212282 May 23 15:30:48.771951 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 65/133] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:48 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:49.349866 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-45eef4c4-7aa1-40ff-b3e2-c9dbe4c37c7c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:49.350487 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-45eef4c4-7aa1-40ff-b3e2-c9dbe4c37c7c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:49.359451 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-45eef4c4-7aa1-40ff-b3e2-c9dbe4c37c7c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:49.360283 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-45eef4c4-7aa1-40ff-b3e2-c9dbe4c37c7c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:49.361282 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-45eef4c4-7aa1-40ff-b3e2-c9dbe4c37c7c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:49.362076 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-45eef4c4-7aa1-40ff-b3e2-c9dbe4c37c7c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:49.461177 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e26303e1-a8a3-463a-85be-e358e4f8a781 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:49.462339 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e26303e1-a8a3-463a-85be-e358e4f8a781 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:49.475209 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e26303e1-a8a3-463a-85be-e358e4f8a781 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:49.476510 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e26303e1-a8a3-463a-85be-e358e4f8a781 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:49.478279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e26303e1-a8a3-463a-85be-e358e4f8a781 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:49.479284 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e26303e1-a8a3-463a-85be-e358e4f8a781 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:49.532407 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e26303e1-a8a3-463a-85be-e358e4f8a781 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Going to try to terminate instance {{(pid=117974) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:30:49.594007 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-45eef4c4-7aa1-40ff-b3e2-c9dbe4c37c7c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:49.602228 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-45eef4c4-7aa1-40ff-b3e2-c9dbe4c37c7c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1365 microversion: 2.1 time: 0.256881 May 23 15:30:49.602812 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 69/134] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:49 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:49.615879 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ba8b3dc7-afcc-497e-a951-4e956cd9fa57 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:49.616542 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ba8b3dc7-afcc-497e-a951-4e956cd9fa57 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:49.623112 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ba8b3dc7-afcc-497e-a951-4e956cd9fa57 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:49.623777 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ba8b3dc7-afcc-497e-a951-4e956cd9fa57 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:49.624563 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ba8b3dc7-afcc-497e-a951-4e956cd9fa57 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:49.625037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ba8b3dc7-afcc-497e-a951-4e956cd9fa57 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:49.689869 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e26303e1-a8a3-463a-85be-e358e4f8a781 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 204 len: 0 microversion: 2.1 time: 0.232327 May 23 15:30:49.690926 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 66/135] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:30:49 2022] DELETE /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 15:30:49.720198 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-41ebccfd-b64f-419d-8299-e8070f4c3263 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:49.721292 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-41ebccfd-b64f-419d-8299-e8070f4c3263 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:49.730159 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-41ebccfd-b64f-419d-8299-e8070f4c3263 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:49.731216 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-41ebccfd-b64f-419d-8299-e8070f4c3263 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:49.732269 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-41ebccfd-b64f-419d-8299-e8070f4c3263 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:49.733154 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-41ebccfd-b64f-419d-8299-e8070f4c3263 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:49.830541 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ba8b3dc7-afcc-497e-a951-4e956cd9fa57 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:49.841266 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ba8b3dc7-afcc-497e-a951-4e956cd9fa57 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1361 microversion: 2.1 time: 0.228917 May 23 15:30:49.841914 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 70/136] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:49 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:49.849533 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-608e0a1d-503c-4143-a28f-a9e072420eca tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:49.850511 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-608e0a1d-503c-4143-a28f-a9e072420eca tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:49.858878 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-608e0a1d-503c-4143-a28f-a9e072420eca tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:49.859784 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-608e0a1d-503c-4143-a28f-a9e072420eca tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:49.860976 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-608e0a1d-503c-4143-a28f-a9e072420eca tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:49.861588 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-608e0a1d-503c-4143-a28f-a9e072420eca tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:49.998223 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-41ebccfd-b64f-419d-8299-e8070f4c3263 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:50.007310 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-41ebccfd-b64f-419d-8299-e8070f4c3263 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1553 microversion: 2.1 time: 0.296257 May 23 15:30:50.007927 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 67/137] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:49 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1553 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:50.020936 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-608e0a1d-503c-4143-a28f-a9e072420eca tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:50.029718 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-608e0a1d-503c-4143-a28f-a9e072420eca tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.185739 May 23 15:30:50.030290 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 71/138] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:49 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:50.623528 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-554f5e7d-1b41-45dd-9319-618a0add5b74 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:50.624662 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-554f5e7d-1b41-45dd-9319-618a0add5b74 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:50.635434 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-554f5e7d-1b41-45dd-9319-618a0add5b74 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:50.636394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-554f5e7d-1b41-45dd-9319-618a0add5b74 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:50.637710 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-554f5e7d-1b41-45dd-9319-618a0add5b74 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:50.638319 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-554f5e7d-1b41-45dd-9319-618a0add5b74 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:50.811432 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-554f5e7d-1b41-45dd-9319-618a0add5b74 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:50.821873 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-554f5e7d-1b41-45dd-9319-618a0add5b74 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1553 microversion: 2.1 time: 0.206207 May 23 15:30:50.822731 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 68/139] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:50 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1553 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:50.841853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-88cd16f0-a993-479f-9e9b-f4001f36817f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:50.842361 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-88cd16f0-a993-479f-9e9b-f4001f36817f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:50.853585 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-88cd16f0-a993-479f-9e9b-f4001f36817f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:50.857470 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-88cd16f0-a993-479f-9e9b-f4001f36817f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:50.858641 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-88cd16f0-a993-479f-9e9b-f4001f36817f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:50.860055 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f9a778e1-762a-44ef-94a5-daa937ca21bf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:50.860708 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f9a778e1-762a-44ef-94a5-daa937ca21bf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:50.860839 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-88cd16f0-a993-479f-9e9b-f4001f36817f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:50.867976 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f9a778e1-762a-44ef-94a5-daa937ca21bf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:50.868727 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f9a778e1-762a-44ef-94a5-daa937ca21bf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:50.869861 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f9a778e1-762a-44ef-94a5-daa937ca21bf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:50.870578 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f9a778e1-762a-44ef-94a5-daa937ca21bf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:50.979595 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-88cd16f0-a993-479f-9e9b-f4001f36817f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143898 May 23 15:30:50.985797 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 72/140] 10.222.0.30 () {58 vars in 1274 bytes} [Mon May 23 15:30:50 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:30:51.025374 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-9d0ab9f0-79b3-4867-8b05-77303a782408 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:51.026250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-9d0ab9f0-79b3-4867-8b05-77303a782408 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:51.033554 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9d0ab9f0-79b3-4867-8b05-77303a782408 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:51.034203 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9d0ab9f0-79b3-4867-8b05-77303a782408 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:51.035162 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9d0ab9f0-79b3-4867-8b05-77303a782408 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:51.035798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9d0ab9f0-79b3-4867-8b05-77303a782408 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:51.065780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-f9a778e1-762a-44ef-94a5-daa937ca21bf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:51.076505 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f9a778e1-762a-44ef-94a5-daa937ca21bf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1546 microversion: 2.1 time: 0.221193 May 23 15:30:51.077789 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 69/141] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:50 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1546 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:51.082667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ba0cddd2-1d0e-480e-a055-65c8b07a79bc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:51.083547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ba0cddd2-1d0e-480e-a055-65c8b07a79bc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:51.094759 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ba0cddd2-1d0e-480e-a055-65c8b07a79bc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:51.095905 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ba0cddd2-1d0e-480e-a055-65c8b07a79bc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:51.097369 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ba0cddd2-1d0e-480e-a055-65c8b07a79bc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:51.097808 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ba0cddd2-1d0e-480e-a055-65c8b07a79bc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:51.250862 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ba0cddd2-1d0e-480e-a055-65c8b07a79bc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:51.258503 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ba0cddd2-1d0e-480e-a055-65c8b07a79bc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.179339 May 23 15:30:51.260133 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 70/142] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:51 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:51.266818 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-46e5bf8b-f2e3-42c3-b3b5-81c04ec03274 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:51.267974 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-46e5bf8b-f2e3-42c3-b3b5-81c04ec03274 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:51.275006 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-46e5bf8b-f2e3-42c3-b3b5-81c04ec03274 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:51.275660 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-46e5bf8b-f2e3-42c3-b3b5-81c04ec03274 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:51.277130 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-46e5bf8b-f2e3-42c3-b3b5-81c04ec03274 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:51.277717 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-46e5bf8b-f2e3-42c3-b3b5-81c04ec03274 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:51.364969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-46e5bf8b-f2e3-42c3-b3b5-81c04ec03274 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103531 May 23 15:30:51.365828 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 71/143] 10.222.0.30 () {58 vars in 1274 bytes} [Mon May 23 15:30:51 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:30:51.389886 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9d0ab9f0-79b3-4867-8b05-77303a782408 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:51.399769 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-9d0ab9f0-79b3-4867-8b05-77303a782408 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1553 microversion: 2.1 time: 0.378055 May 23 15:30:51.400633 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 73/144] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:51 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1553 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:52.278937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-96092f00-c788-4c17-b9bc-55ac876fdd5c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:52.279620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-96092f00-c788-4c17-b9bc-55ac876fdd5c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:52.286325 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96092f00-c788-4c17-b9bc-55ac876fdd5c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:52.287008 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96092f00-c788-4c17-b9bc-55ac876fdd5c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:52.288611 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96092f00-c788-4c17-b9bc-55ac876fdd5c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:52.289180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96092f00-c788-4c17-b9bc-55ac876fdd5c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:52.420988 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-011a1c2e-8eb4-4ae1-95b8-b83a003cf708 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:52.421787 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-011a1c2e-8eb4-4ae1-95b8-b83a003cf708 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:52.452216 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-011a1c2e-8eb4-4ae1-95b8-b83a003cf708 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:52.454369 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-011a1c2e-8eb4-4ae1-95b8-b83a003cf708 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:52.455298 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-011a1c2e-8eb4-4ae1-95b8-b83a003cf708 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:52.457270 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-011a1c2e-8eb4-4ae1-95b8-b83a003cf708 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:52.477318 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:52.510312 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-96092f00-c788-4c17-b9bc-55ac876fdd5c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:52.519503 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-96092f00-c788-4c17-b9bc-55ac876fdd5c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.245959 May 23 15:30:52.520085 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 72/145] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:52 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:52.534880 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-891f8f3c-1616-4ea0-b605-eea4bd65ddd3 req-ac8b36b3-46cc-4cb7-92cf-345e561f7513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e1c71d3-9470-4f72-a76c-e6c114bd4821", "tag": "9beaf3ec-d7f6-4009-b3ff-01ff1bc11a9e"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:52.546858 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-891f8f3c-1616-4ea0-b605-eea4bd65ddd3 req-ac8b36b3-46cc-4cb7-92cf-345e561f7513 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:52.547609 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-891f8f3c-1616-4ea0-b605-eea4bd65ddd3 req-ac8b36b3-46cc-4cb7-92cf-345e561f7513 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:52.565472 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-891f8f3c-1616-4ea0-b605-eea4bd65ddd3 req-ac8b36b3-46cc-4cb7-92cf-345e561f7513 service nova] Creating event network-changed:9beaf3ec-d7f6-4009-b3ff-01ff1bc11a9e for instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 on hv-cinder-84112 May 23 15:30:52.572727 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-891f8f3c-1616-4ea0-b605-eea4bd65ddd3 req-ac8b36b3-46cc-4cb7-92cf-345e561f7513 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047968 May 23 15:30:52.576096 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 73/146] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:30:52.589147 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-0bc9527a-aa4a-4e66-817f-557ef2ae434d req-d6cb2188-13f9-48ca-a6e1-ef5ae06b7375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30f7223-50a4-46a7-b9df-cc24cc0ba14e", "tag": "844b0f3e-da49-4384-9cfa-321053312dea"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:52.600823 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-0bc9527a-aa4a-4e66-817f-557ef2ae434d req-d6cb2188-13f9-48ca-a6e1-ef5ae06b7375 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:52.601551 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-0bc9527a-aa4a-4e66-817f-557ef2ae434d req-d6cb2188-13f9-48ca-a6e1-ef5ae06b7375 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:52.621166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-0bc9527a-aa4a-4e66-817f-557ef2ae434d req-d6cb2188-13f9-48ca-a6e1-ef5ae06b7375 service nova] Creating event network-changed:844b0f3e-da49-4384-9cfa-321053312dea for instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e on hv-cinder-84112 May 23 15:30:52.626790 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-0bc9527a-aa4a-4e66-817f-557ef2ae434d req-d6cb2188-13f9-48ca-a6e1-ef5ae06b7375 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047934 May 23 15:30:52.627580 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 74/147] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:30:52.642839 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-011a1c2e-8eb4-4ae1-95b8-b83a003cf708 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:52.650854 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-011a1c2e-8eb4-4ae1-95b8-b83a003cf708 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1553 microversion: 2.1 time: 0.235969 May 23 15:30:52.651520 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 74/148] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:52 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1553 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:53.539059 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-de3b4110-0e8f-42c8-910d-78e16816ab79 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:53.540527 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-de3b4110-0e8f-42c8-910d-78e16816ab79 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:53.547940 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-de3b4110-0e8f-42c8-910d-78e16816ab79 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:53.548401 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-de3b4110-0e8f-42c8-910d-78e16816ab79 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:53.549213 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-de3b4110-0e8f-42c8-910d-78e16816ab79 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:53.549812 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-de3b4110-0e8f-42c8-910d-78e16816ab79 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:53.668164 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a7b72683-c02f-4a46-987e-77ee3c85fa46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:53.670060 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-a7b72683-c02f-4a46-987e-77ee3c85fa46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:53.676919 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a7b72683-c02f-4a46-987e-77ee3c85fa46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:53.677658 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a7b72683-c02f-4a46-987e-77ee3c85fa46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:53.678649 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a7b72683-c02f-4a46-987e-77ee3c85fa46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:53.679447 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a7b72683-c02f-4a46-987e-77ee3c85fa46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:53.705400 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-de3b4110-0e8f-42c8-910d-78e16816ab79 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:53.707785 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:53.719103 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-de3b4110-0e8f-42c8-910d-78e16816ab79 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.185066 May 23 15:30:53.719700 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 75/149] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:53 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:53.822656 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a7b72683-c02f-4a46-987e-77ee3c85fa46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:53.830943 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a7b72683-c02f-4a46-987e-77ee3c85fa46 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1553 microversion: 2.1 time: 0.167355 May 23 15:30:53.831508 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 75/150] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:53 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:54.737731 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c6c1c977-4980-4fc2-b8d9-0d19aceb784f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:54.738380 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-c6c1c977-4980-4fc2-b8d9-0d19aceb784f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:54.748794 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c6c1c977-4980-4fc2-b8d9-0d19aceb784f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:54.749278 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c6c1c977-4980-4fc2-b8d9-0d19aceb784f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:54.750061 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c6c1c977-4980-4fc2-b8d9-0d19aceb784f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:54.750504 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c6c1c977-4980-4fc2-b8d9-0d19aceb784f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:54.848741 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-905fa590-baa0-41a8-856d-978cfed2e762 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:54.850791 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-905fa590-baa0-41a8-856d-978cfed2e762 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:54.857188 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-905fa590-baa0-41a8-856d-978cfed2e762 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:54.857644 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-905fa590-baa0-41a8-856d-978cfed2e762 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:54.858431 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-905fa590-baa0-41a8-856d-978cfed2e762 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:54.858869 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-905fa590-baa0-41a8-856d-978cfed2e762 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:54.896173 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c6c1c977-4980-4fc2-b8d9-0d19aceb784f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:54.904543 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-c6c1c977-4980-4fc2-b8d9-0d19aceb784f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.171817 May 23 15:30:54.905164 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 76/151] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:54 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:54.993121 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-905fa590-baa0-41a8-856d-978cfed2e762 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:55.001813 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-905fa590-baa0-41a8-856d-978cfed2e762 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1553 microversion: 2.1 time: 0.156888 May 23 15:30:55.002380 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 76/152] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:54 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:55.922243 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-685e074b-8c9d-4b14-8e17-59a9443603b4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:55.922865 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-685e074b-8c9d-4b14-8e17-59a9443603b4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:55.929381 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-685e074b-8c9d-4b14-8e17-59a9443603b4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:55.929833 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-685e074b-8c9d-4b14-8e17-59a9443603b4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:55.930600 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-685e074b-8c9d-4b14-8e17-59a9443603b4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:55.931038 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-685e074b-8c9d-4b14-8e17-59a9443603b4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:56.019654 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-0a9133dd-0643-4c38-83fe-05e27f867ac3 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:56.020299 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-0a9133dd-0643-4c38-83fe-05e27f867ac3 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:56.027202 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0a9133dd-0643-4c38-83fe-05e27f867ac3 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:56.027650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0a9133dd-0643-4c38-83fe-05e27f867ac3 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:56.028421 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0a9133dd-0643-4c38-83fe-05e27f867ac3 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:56.028852 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0a9133dd-0643-4c38-83fe-05e27f867ac3 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:56.172477 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-0a9133dd-0643-4c38-83fe-05e27f867ac3 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:56.181173 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-0a9133dd-0643-4c38-83fe-05e27f867ac3 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1553 microversion: 2.1 time: 0.165294 May 23 15:30:56.191128 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 77/153] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:56 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:56.245869 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-685e074b-8c9d-4b14-8e17-59a9443603b4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:56.253336 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-685e074b-8c9d-4b14-8e17-59a9443603b4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.335597 May 23 15:30:56.253910 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 77/154] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:55 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:57.198857 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7f41c9f8-cfa9-4f31-a646-224c093aa9d3 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:57.199517 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7f41c9f8-cfa9-4f31-a646-224c093aa9d3 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:57.205947 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7f41c9f8-cfa9-4f31-a646-224c093aa9d3 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:57.206396 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7f41c9f8-cfa9-4f31-a646-224c093aa9d3 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:57.207169 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7f41c9f8-cfa9-4f31-a646-224c093aa9d3 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:57.207611 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7f41c9f8-cfa9-4f31-a646-224c093aa9d3 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:57.270380 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4c9788cd-d73d-414a-a660-7afddb5d90aa tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:57.271015 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4c9788cd-d73d-414a-a660-7afddb5d90aa tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:57.277489 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c9788cd-d73d-414a-a660-7afddb5d90aa tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:57.277939 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c9788cd-d73d-414a-a660-7afddb5d90aa tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:57.278704 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c9788cd-d73d-414a-a660-7afddb5d90aa tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:57.279139 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c9788cd-d73d-414a-a660-7afddb5d90aa tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:57.338976 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-7f41c9f8-cfa9-4f31-a646-224c093aa9d3 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:57.348291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7f41c9f8-cfa9-4f31-a646-224c093aa9d3 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1553 microversion: 2.1 time: 0.153778 May 23 15:30:57.348886 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 78/155] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:57 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:57.411502 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4c9788cd-d73d-414a-a660-7afddb5d90aa tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:57.419490 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4c9788cd-d73d-414a-a660-7afddb5d90aa tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.152985 May 23 15:30:57.420062 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 78/156] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:57 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:58.367708 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-4b0a725f-71a1-4ccc-b4b4-6bf3461f3ce2 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:58.368396 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-4b0a725f-71a1-4ccc-b4b4-6bf3461f3ce2 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:58.374922 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4b0a725f-71a1-4ccc-b4b4-6bf3461f3ce2 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:58.375377 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4b0a725f-71a1-4ccc-b4b4-6bf3461f3ce2 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:58.376407 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4b0a725f-71a1-4ccc-b4b4-6bf3461f3ce2 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:58.377040 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4b0a725f-71a1-4ccc-b4b4-6bf3461f3ce2 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:58.437162 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4a4a42c1-a8c6-41ca-88c7-aee79cadbdc3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:58.437778 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4a4a42c1-a8c6-41ca-88c7-aee79cadbdc3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:58.443858 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4a4a42c1-a8c6-41ca-88c7-aee79cadbdc3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:58.444492 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4a4a42c1-a8c6-41ca-88c7-aee79cadbdc3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:58.445283 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4a4a42c1-a8c6-41ca-88c7-aee79cadbdc3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:58.445873 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4a4a42c1-a8c6-41ca-88c7-aee79cadbdc3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:58.625886 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-4b0a725f-71a1-4ccc-b4b4-6bf3461f3ce2 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:58.646487 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-4b0a725f-71a1-4ccc-b4b4-6bf3461f3ce2 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1553 microversion: 2.1 time: 0.284384 May 23 15:30:58.666954 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 79/157] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:58 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1553 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:58.777674 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4a4a42c1-a8c6-41ca-88c7-aee79cadbdc3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:58.785317 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4a4a42c1-a8c6-41ca-88c7-aee79cadbdc3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.352773 May 23 15:30:58.785983 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 79/158] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:58 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:30:59.260541 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-a2ce60e2-ce90-4f5d-b90c-704562cb9a67 req-b122dd7c-c8d9-4d1c-a914-e7d5aa0f9a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7abcf413-0c08-4f11-b030-2f2f9f09a5a3", "name": "network-vif-deleted", "tag": "07333c01-2c53-4cf7-a086-18422eb283db"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:30:59.269118 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-a2ce60e2-ce90-4f5d-b90c-704562cb9a67 req-b122dd7c-c8d9-4d1c-a914-e7d5aa0f9a45 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:59.269567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-a2ce60e2-ce90-4f5d-b90c-704562cb9a67 req-b122dd7c-c8d9-4d1c-a914-e7d5aa0f9a45 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:59.286617 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-a2ce60e2-ce90-4f5d-b90c-704562cb9a67 req-b122dd7c-c8d9-4d1c-a914-e7d5aa0f9a45 service nova] Creating event network-vif-deleted:07333c01-2c53-4cf7-a086-18422eb283db for instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 on hv-cinder-84112 May 23 15:30:59.291952 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-a2ce60e2-ce90-4f5d-b90c-704562cb9a67 req-b122dd7c-c8d9-4d1c-a914-e7d5aa0f9a45 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035070 May 23 15:30:59.293451 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 80/159] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:30:59.668297 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-7fabbe79-6765-4147-9835-ae0ca702aa1c tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:59.668921 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-7fabbe79-6765-4147-9835-ae0ca702aa1c tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:59.675548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7fabbe79-6765-4147-9835-ae0ca702aa1c tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:59.676007 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7fabbe79-6765-4147-9835-ae0ca702aa1c tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:59.676779 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7fabbe79-6765-4147-9835-ae0ca702aa1c tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:59.677249 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7fabbe79-6765-4147-9835-ae0ca702aa1c tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:59.741891 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-7fabbe79-6765-4147-9835-ae0ca702aa1c tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:59.749965 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-7fabbe79-6765-4147-9835-ae0ca702aa1c tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1511 microversion: 2.1 time: 0.086182 May 23 15:30:59.750541 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 80/160] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:59 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1511 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:30:59.803485 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-fbb74f88-7d5b-4809-bd1a-03c212bcaff3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:30:59.804216 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-fbb74f88-7d5b-4809-bd1a-03c212bcaff3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:30:59.811019 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fbb74f88-7d5b-4809-bd1a-03c212bcaff3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:59.811470 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fbb74f88-7d5b-4809-bd1a-03c212bcaff3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:59.812235 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fbb74f88-7d5b-4809-bd1a-03c212bcaff3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:30:59.812674 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fbb74f88-7d5b-4809-bd1a-03c212bcaff3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:30:59.940355 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-fbb74f88-7d5b-4809-bd1a-03c212bcaff3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:30:59.947806 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-fbb74f88-7d5b-4809-bd1a-03c212bcaff3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.148534 May 23 15:30:59.948959 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 81/161] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:30:59 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:00.767318 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-842ccf7a-da53-4c6e-baa4-7850159c18c9 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:00.767939 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-842ccf7a-da53-4c6e-baa4-7850159c18c9 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:00.774418 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-842ccf7a-da53-4c6e-baa4-7850159c18c9 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:00.774871 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-842ccf7a-da53-4c6e-baa4-7850159c18c9 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:00.775635 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-842ccf7a-da53-4c6e-baa4-7850159c18c9 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:00.776076 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-842ccf7a-da53-4c6e-baa4-7850159c18c9 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:00.840516 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-842ccf7a-da53-4c6e-baa4-7850159c18c9 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:00.849568 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-842ccf7a-da53-4c6e-baa4-7850159c18c9 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1511 microversion: 2.1 time: 0.086022 May 23 15:31:00.850136 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 81/162] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:00 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1511 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:00.965442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-2c4850bf-41a9-4620-92c2-d0bd53030ab2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:00.965961 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-2c4850bf-41a9-4620-92c2-d0bd53030ab2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:00.972164 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2c4850bf-41a9-4620-92c2-d0bd53030ab2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:00.972619 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2c4850bf-41a9-4620-92c2-d0bd53030ab2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:00.973428 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2c4850bf-41a9-4620-92c2-d0bd53030ab2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:00.973871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2c4850bf-41a9-4620-92c2-d0bd53030ab2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:01.099842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-2c4850bf-41a9-4620-92c2-d0bd53030ab2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:01.107855 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-2c4850bf-41a9-4620-92c2-d0bd53030ab2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.146412 May 23 15:31:01.108423 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 82/163] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:00 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:01.867912 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c846968e-35c6-499a-84d8-b7b2db67d3ce tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:01.868636 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-c846968e-35c6-499a-84d8-b7b2db67d3ce tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:01.876234 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c846968e-35c6-499a-84d8-b7b2db67d3ce tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:01.876766 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c846968e-35c6-499a-84d8-b7b2db67d3ce tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:01.877780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c846968e-35c6-499a-84d8-b7b2db67d3ce tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:01.878513 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c846968e-35c6-499a-84d8-b7b2db67d3ce tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:01.944472 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c846968e-35c6-499a-84d8-b7b2db67d3ce tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:01.952581 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-c846968e-35c6-499a-84d8-b7b2db67d3ce tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1511 microversion: 2.1 time: 0.089711 May 23 15:31:01.953591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 82/164] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:01 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1511 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:02.125201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-114cc13a-ae69-446c-a73f-6067f9cd0086 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:02.125814 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-114cc13a-ae69-446c-a73f-6067f9cd0086 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:02.131732 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-114cc13a-ae69-446c-a73f-6067f9cd0086 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:02.132175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-114cc13a-ae69-446c-a73f-6067f9cd0086 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:02.133076 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-114cc13a-ae69-446c-a73f-6067f9cd0086 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:02.133512 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-114cc13a-ae69-446c-a73f-6067f9cd0086 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:02.306555 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-114cc13a-ae69-446c-a73f-6067f9cd0086 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:02.314139 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-114cc13a-ae69-446c-a73f-6067f9cd0086 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.193054 May 23 15:31:02.314697 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 83/165] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:02 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:02.970631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-04886bb8-72e6-4a4d-9baa-1b6a6f9e9de0 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:02.971286 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-04886bb8-72e6-4a4d-9baa-1b6a6f9e9de0 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:02.977287 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-04886bb8-72e6-4a4d-9baa-1b6a6f9e9de0 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:02.977740 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-04886bb8-72e6-4a4d-9baa-1b6a6f9e9de0 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:02.978505 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-04886bb8-72e6-4a4d-9baa-1b6a6f9e9de0 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:02.978946 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-04886bb8-72e6-4a4d-9baa-1b6a6f9e9de0 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:03.041596 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-04886bb8-72e6-4a4d-9baa-1b6a6f9e9de0 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:03.050116 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-04886bb8-72e6-4a4d-9baa-1b6a6f9e9de0 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1511 microversion: 2.1 time: 0.083456 May 23 15:31:03.050690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 83/166] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:02 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1511 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:03.330876 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-70f2c54e-7852-4f50-a665-7b3af1ed3dd1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:03.331422 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-70f2c54e-7852-4f50-a665-7b3af1ed3dd1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:03.337556 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-70f2c54e-7852-4f50-a665-7b3af1ed3dd1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:03.338008 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-70f2c54e-7852-4f50-a665-7b3af1ed3dd1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:03.338775 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-70f2c54e-7852-4f50-a665-7b3af1ed3dd1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:03.339856 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-70f2c54e-7852-4f50-a665-7b3af1ed3dd1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:03.466409 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-70f2c54e-7852-4f50-a665-7b3af1ed3dd1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:03.473787 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-70f2c54e-7852-4f50-a665-7b3af1ed3dd1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.146814 May 23 15:31:03.474351 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 84/167] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:03 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:04.067751 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c9267932-e2f0-4a17-b602-11fade70ddae tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:04.068364 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-c9267932-e2f0-4a17-b602-11fade70ddae tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:04.074964 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c9267932-e2f0-4a17-b602-11fade70ddae tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:04.075409 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c9267932-e2f0-4a17-b602-11fade70ddae tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:04.076172 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c9267932-e2f0-4a17-b602-11fade70ddae tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:04.076610 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c9267932-e2f0-4a17-b602-11fade70ddae tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:04.136845 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c9267932-e2f0-4a17-b602-11fade70ddae tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:04.145014 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-c9267932-e2f0-4a17-b602-11fade70ddae tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1511 microversion: 2.1 time: 0.081010 May 23 15:31:04.145591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 84/168] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:04 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1511 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:04.491222 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-0c69a152-ada8-4524-b9ce-5486f0b49037 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:04.491851 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-0c69a152-ada8-4524-b9ce-5486f0b49037 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:04.498596 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0c69a152-ada8-4524-b9ce-5486f0b49037 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:04.499048 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0c69a152-ada8-4524-b9ce-5486f0b49037 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:04.499816 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0c69a152-ada8-4524-b9ce-5486f0b49037 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:04.500256 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0c69a152-ada8-4524-b9ce-5486f0b49037 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:04.631094 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-0c69a152-ada8-4524-b9ce-5486f0b49037 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:04.639058 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-0c69a152-ada8-4524-b9ce-5486f0b49037 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.151732 May 23 15:31:04.639623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 85/169] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:04 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:05.162863 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-af706974-6d29-4380-90a9-c95d9e1001e6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:05.163485 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-af706974-6d29-4380-90a9-c95d9e1001e6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:05.172016 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-af706974-6d29-4380-90a9-c95d9e1001e6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:05.173441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-af706974-6d29-4380-90a9-c95d9e1001e6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:05.174241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-af706974-6d29-4380-90a9-c95d9e1001e6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:05.174724 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-af706974-6d29-4380-90a9-c95d9e1001e6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:05.236161 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-af706974-6d29-4380-90a9-c95d9e1001e6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:05.243882 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-af706974-6d29-4380-90a9-c95d9e1001e6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1511 microversion: 2.1 time: 0.084902 May 23 15:31:05.244436 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 85/170] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:05 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1511 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:05.655787 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-be83b96d-92f5-4f41-a19e-c73d92f039b4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:05.656845 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-be83b96d-92f5-4f41-a19e-c73d92f039b4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:05.663293 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-be83b96d-92f5-4f41-a19e-c73d92f039b4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:05.663766 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-be83b96d-92f5-4f41-a19e-c73d92f039b4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:05.664632 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-be83b96d-92f5-4f41-a19e-c73d92f039b4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:05.665410 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-be83b96d-92f5-4f41-a19e-c73d92f039b4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:05.832638 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-be83b96d-92f5-4f41-a19e-c73d92f039b4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:05.840222 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-be83b96d-92f5-4f41-a19e-c73d92f039b4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.188601 May 23 15:31:05.840787 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 86/171] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:05 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:06.262240 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-aebd6034-5c6b-457e-957d-b628a7e5e359 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:06.262798 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-aebd6034-5c6b-457e-957d-b628a7e5e359 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:06.269428 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aebd6034-5c6b-457e-957d-b628a7e5e359 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:06.269895 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aebd6034-5c6b-457e-957d-b628a7e5e359 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:06.270652 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aebd6034-5c6b-457e-957d-b628a7e5e359 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:06.271087 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aebd6034-5c6b-457e-957d-b628a7e5e359 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:06.318323 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aebd6034-5c6b-457e-957d-b628a7e5e359 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:06.319141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aebd6034-5c6b-457e-957d-b628a7e5e359 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:06.319804 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-aebd6034-5c6b-457e-957d-b628a7e5e359 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lazy-loading 'fault' on Instance uuid 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:31:06.373238 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-aebd6034-5c6b-457e-957d-b628a7e5e359 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:06.382143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-aebd6034-5c6b-457e-957d-b628a7e5e359 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1516 microversion: 2.1 time: 0.124092 May 23 15:31:06.382709 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 86/172] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:06 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1516 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:06.857627 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-dc5909af-5f8d-43a4-a9b8-ee4f8c24ef46 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:06.858368 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-dc5909af-5f8d-43a4-a9b8-ee4f8c24ef46 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:06.865109 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-dc5909af-5f8d-43a4-a9b8-ee4f8c24ef46 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:06.865493 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-dc5909af-5f8d-43a4-a9b8-ee4f8c24ef46 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:06.866328 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-dc5909af-5f8d-43a4-a9b8-ee4f8c24ef46 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:06.866690 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-dc5909af-5f8d-43a4-a9b8-ee4f8c24ef46 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:06.995520 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-dc5909af-5f8d-43a4-a9b8-ee4f8c24ef46 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:07.003141 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-dc5909af-5f8d-43a4-a9b8-ee4f8c24ef46 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.149475 May 23 15:31:07.003698 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 87/173] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:06 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:07.400485 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-52ec62c2-cb27-4231-9f70-fd1e2c7fb24d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:07.401126 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-52ec62c2-cb27-4231-9f70-fd1e2c7fb24d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:07.407609 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-52ec62c2-cb27-4231-9f70-fd1e2c7fb24d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:07.408056 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-52ec62c2-cb27-4231-9f70-fd1e2c7fb24d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:07.408814 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-52ec62c2-cb27-4231-9f70-fd1e2c7fb24d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:07.409272 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-52ec62c2-cb27-4231-9f70-fd1e2c7fb24d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:07.443588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-52ec62c2-cb27-4231-9f70-fd1e2c7fb24d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:07.443934 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-52ec62c2-cb27-4231-9f70-fd1e2c7fb24d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:07.444377 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-52ec62c2-cb27-4231-9f70-fd1e2c7fb24d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lazy-loading 'fault' on Instance uuid 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:31:07.486091 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-52ec62c2-cb27-4231-9f70-fd1e2c7fb24d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:07.493985 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-52ec62c2-cb27-4231-9f70-fd1e2c7fb24d tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1516 microversion: 2.1 time: 0.097336 May 23 15:31:07.494552 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 87/174] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:07 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1516 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:08.022042 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-2ea34c21-9050-41df-9d56-3e0fc970e0fe tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:08.022749 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-2ea34c21-9050-41df-9d56-3e0fc970e0fe tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:08.026139 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=74 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:08.031085 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2ea34c21-9050-41df-9d56-3e0fc970e0fe tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:08.031904 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2ea34c21-9050-41df-9d56-3e0fc970e0fe tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:08.032349 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2ea34c21-9050-41df-9d56-3e0fc970e0fe tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:08.032780 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2ea34c21-9050-41df-9d56-3e0fc970e0fe tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:08.170508 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-2ea34c21-9050-41df-9d56-3e0fc970e0fe tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:08.178095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-2ea34c21-9050-41df-9d56-3e0fc970e0fe tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.160775 May 23 15:31:08.178681 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 88/175] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:08 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:08.511674 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-45cc977c-28ae-4b95-8dea-5c2936fcf6a1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:08.512382 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-45cc977c-28ae-4b95-8dea-5c2936fcf6a1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:08.518805 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-45cc977c-28ae-4b95-8dea-5c2936fcf6a1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:08.519285 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-45cc977c-28ae-4b95-8dea-5c2936fcf6a1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:08.520045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-45cc977c-28ae-4b95-8dea-5c2936fcf6a1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:08.520480 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-45cc977c-28ae-4b95-8dea-5c2936fcf6a1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:08.551323 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-45cc977c-28ae-4b95-8dea-5c2936fcf6a1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:08.551766 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-45cc977c-28ae-4b95-8dea-5c2936fcf6a1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:08.552211 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-45cc977c-28ae-4b95-8dea-5c2936fcf6a1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lazy-loading 'fault' on Instance uuid 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:31:08.591835 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-45cc977c-28ae-4b95-8dea-5c2936fcf6a1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91e38a712074ca5a2567da012445aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '377219e53ce94ab089e48437d3468663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:08.600048 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-45cc977c-28ae-4b95-8dea-5c2936fcf6a1 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 200 len: 1516 microversion: 2.1 time: 0.092538 May 23 15:31:08.600616 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 88/176] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:08 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 1516 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:09.195672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8ee5b93e-8541-4ca6-8f9c-f1175fc50db7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:09.196406 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8ee5b93e-8541-4ca6-8f9c-f1175fc50db7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:09.202865 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8ee5b93e-8541-4ca6-8f9c-f1175fc50db7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:09.203322 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8ee5b93e-8541-4ca6-8f9c-f1175fc50db7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:09.204094 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8ee5b93e-8541-4ca6-8f9c-f1175fc50db7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:09.204536 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8ee5b93e-8541-4ca6-8f9c-f1175fc50db7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:09.334022 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8ee5b93e-8541-4ca6-8f9c-f1175fc50db7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:09.342419 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8ee5b93e-8541-4ca6-8f9c-f1175fc50db7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.150567 May 23 15:31:09.343100 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 89/177] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:09 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:31:09.617893 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8e7fa122-0870-499e-a074-62e2148779d6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:09.618529 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8e7fa122-0870-499e-a074-62e2148779d6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:09.625832 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8e7fa122-0870-499e-a074-62e2148779d6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:09.626281 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8e7fa122-0870-499e-a074-62e2148779d6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:09.627039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8e7fa122-0870-499e-a074-62e2148779d6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:09.627473 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8e7fa122-0870-499e-a074-62e2148779d6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:09.640822 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-8e7fa122-0870-499e-a074-62e2148779d6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] HTTP exception thrown: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8e7fa122-0870-499e-a074-62e2148779d6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Request method failure captured: May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 HTTP/1.1 May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6hrEq-otZDN6XmEJyOh0cOrCPIuzvfDx7yelihdYa909nFZj1y8UGUpVhV0El6IRGHRioiR-P_QovjUqnIQfRArGoAWUNu1aoT_y2RhaT61-zCR7uOion4c7U7kXlvPYC6K6NkiduIX9UO2iQPkCexUPEauFkkWxUQuw25zvDmPzN4 May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 377219e53ce94ab089e48437d3468663 May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-DeleteServersTestJSON-1828795085 May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:31:09.645548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:31:09.647142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/377219e53ce94ab089e48437d3468663"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/377219e53ce94ab089e48437d3468663"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/377219e53ce94ab089e48437d3468663"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_377219e53ce94ab089e48437d3468663", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:31:09.647142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-DeleteServersTestJSON-1828795085 May 23 15:31:09.647142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 377219e53ce94ab089e48437d3468663 May 23 15:31:09.647142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-DeleteServersTestJSON-1828795085 May 23 15:31:09.647142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-DeleteServersTestJSON-1828795085-project May 23 15:31:09.647142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:31:09.647142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:31:09.647142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: e91e38a712074ca5a2567da012445aa3 May 23 15:31:09.647142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-DeleteServersTestJSON-1828795085-project May 23 15:31:09.647142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:31:09.647142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:09.647142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '7abcf413-0c08-4f11-b030-2f2f9f09a5a3'} May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:31:09.647956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:09.649191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:31:09.650226 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8e7fa122-0870-499e-a074-62e2148779d6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Returning 404 to user: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:31:09.650226 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8e7fa122-0870-499e-a074-62e2148779d6 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 404 len: 111 microversion: 2.1 time: 0.033047 May 23 15:31:09.650226 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 89/178] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:09 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:31:09.756996 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ad6c37dd-fcb2-49cc-9ec4-9ce5356c150a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:09.757982 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ad6c37dd-fcb2-49cc-9ec4-9ce5356c150a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:09.764261 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ad6c37dd-fcb2-49cc-9ec4-9ce5356c150a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:09.764706 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ad6c37dd-fcb2-49cc-9ec4-9ce5356c150a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:09.765497 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ad6c37dd-fcb2-49cc-9ec4-9ce5356c150a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:09.765933 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ad6c37dd-fcb2-49cc-9ec4-9ce5356c150a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:09.778978 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-ad6c37dd-fcb2-49cc-9ec4-9ce5356c150a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] HTTP exception thrown: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ad6c37dd-fcb2-49cc-9ec4-9ce5356c150a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Request method failure captured: May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3/os-volume_attachments HTTP/1.1 May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6hrEq-otZDN6XmEJyOh0cOrCPIuzvfDx7yelihdYa909nFZj1y8UGUpVhV0El6IRGHRioiR-P_QovjUqnIQfRArGoAWUNu1aoT_y2RhaT61-zCR7uOion4c7U7kXlvPYC6K6NkiduIX9UO2iQPkCexUPEauFkkWxUQuw25zvDmPzN4 May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: 377219e53ce94ab089e48437d3468663 May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-DeleteServersTestJSON-1828795085 May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:31:09.782983 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:31:09.784260 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/377219e53ce94ab089e48437d3468663"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/377219e53ce94ab089e48437d3468663"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/377219e53ce94ab089e48437d3468663"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_377219e53ce94ab089e48437d3468663", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:31:09.784260 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-DeleteServersTestJSON-1828795085 May 23 15:31:09.784260 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: 377219e53ce94ab089e48437d3468663 May 23 15:31:09.784260 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-DeleteServersTestJSON-1828795085 May 23 15:31:09.784260 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-DeleteServersTestJSON-1828795085-project May 23 15:31:09.784260 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:31:09.784260 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:31:09.784260 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: e91e38a712074ca5a2567da012445aa3 May 23 15:31:09.784260 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-DeleteServersTestJSON-1828795085-project May 23 15:31:09.784260 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:31:09.784260 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:09.784260 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'server_id': '7abcf413-0c08-4f11-b030-2f2f9f09a5a3'} May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:31:09.784957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:09.786104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:31:09.787424 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ad6c37dd-fcb2-49cc-9ec4-9ce5356c150a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Returning 404 to user: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:31:09.787424 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ad6c37dd-fcb2-49cc-9ec4-9ce5356c150a tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031463 May 23 15:31:09.787424 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 90/179] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:31:09 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:31:10.360287 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-aa4213d7-9b48-4293-9549-6acd52d74bf5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:10.360952 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-aa4213d7-9b48-4293-9549-6acd52d74bf5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:10.367098 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aa4213d7-9b48-4293-9549-6acd52d74bf5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:10.367547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aa4213d7-9b48-4293-9549-6acd52d74bf5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:10.368334 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aa4213d7-9b48-4293-9549-6acd52d74bf5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:10.368771 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aa4213d7-9b48-4293-9549-6acd52d74bf5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:10.531777 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-aa4213d7-9b48-4293-9549-6acd52d74bf5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:10.541552 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-aa4213d7-9b48-4293-9549-6acd52d74bf5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.185813 May 23 15:31:10.542333 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 90/180] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:10 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:11.002382 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-341c44b1-2aae-4888-8b61-fdf30b594e03 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:11.002970 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-341c44b1-2aae-4888-8b61-fdf30b594e03 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:11.008923 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-341c44b1-2aae-4888-8b61-fdf30b594e03 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:11.009419 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-341c44b1-2aae-4888-8b61-fdf30b594e03 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:11.010190 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-341c44b1-2aae-4888-8b61-fdf30b594e03 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:11.010618 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-341c44b1-2aae-4888-8b61-fdf30b594e03 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:11.025095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-341c44b1-2aae-4888-8b61-fdf30b594e03 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] HTTP exception thrown: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-341c44b1-2aae-4888-8b61-fdf30b594e03 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Request method failure captured: May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: DELETE /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 HTTP/1.1 May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6hrEq-otZDN6XmEJyOh0cOrCPIuzvfDx7yelihdYa909nFZj1y8UGUpVhV0El6IRGHRioiR-P_QovjUqnIQfRArGoAWUNu1aoT_y2RhaT61-zCR7uOion4c7U7kXlvPYC6K6NkiduIX9UO2iQPkCexUPEauFkkWxUQuw25zvDmPzN4 May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: 377219e53ce94ab089e48437d3468663 May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-DeleteServersTestJSON-1828795085 May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:31:11.027291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:31:11.028702 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/377219e53ce94ab089e48437d3468663"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/377219e53ce94ab089e48437d3468663"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/377219e53ce94ab089e48437d3468663"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_377219e53ce94ab089e48437d3468663", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:31:11.028702 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-DeleteServersTestJSON-1828795085 May 23 15:31:11.028702 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: 377219e53ce94ab089e48437d3468663 May 23 15:31:11.028702 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-DeleteServersTestJSON-1828795085 May 23 15:31:11.028702 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-DeleteServersTestJSON-1828795085-project May 23 15:31:11.028702 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:31:11.028702 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:31:11.028702 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: e91e38a712074ca5a2567da012445aa3 May 23 15:31:11.028702 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-DeleteServersTestJSON-1828795085-project May 23 15:31:11.028702 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:31:11.028702 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:11.028702 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': '7abcf413-0c08-4f11-b030-2f2f9f09a5a3'} May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:31:11.029391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:11.030413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:31:11.031511 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-341c44b1-2aae-4888-8b61-fdf30b594e03 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Returning 404 to user: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:31:11.031511 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-341c44b1-2aae-4888-8b61-fdf30b594e03 tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 404 len: 111 microversion: 2.1 time: 0.030651 May 23 15:31:11.031511 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 91/181] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:31:10 2022] DELETE /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:31:11.037619 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-44255571-2de8-4758-bb1d-54f01417973e tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:11.038729 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-44255571-2de8-4758-bb1d-54f01417973e tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] [instance: 7abcf413-0c08-4f11-b030-2f2f9f09a5a3] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:11.041131 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:11.049509 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-44255571-2de8-4758-bb1d-54f01417973e tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:11.049880 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-44255571-2de8-4758-bb1d-54f01417973e tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:11.050654 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-44255571-2de8-4758-bb1d-54f01417973e tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:11.051087 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-44255571-2de8-4758-bb1d-54f01417973e tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:11.066306 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-44255571-2de8-4758-bb1d-54f01417973e tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] HTTP exception thrown: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-44255571-2de8-4758-bb1d-54f01417973e tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Request method failure captured: May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 HTTP/1.1 May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6hrEq-otZDN6XmEJyOh0cOrCPIuzvfDx7yelihdYa909nFZj1y8UGUpVhV0El6IRGHRioiR-P_QovjUqnIQfRArGoAWUNu1aoT_y2RhaT61-zCR7uOion4c7U7kXlvPYC6K6NkiduIX9UO2iQPkCexUPEauFkkWxUQuw25zvDmPzN4 May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 377219e53ce94ab089e48437d3468663 May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-DeleteServersTestJSON-1828795085 May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:31:11.067821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:31:11.069279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/377219e53ce94ab089e48437d3468663"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/377219e53ce94ab089e48437d3468663"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/377219e53ce94ab089e48437d3468663"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_377219e53ce94ab089e48437d3468663", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:31:11.069279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-DeleteServersTestJSON-1828795085 May 23 15:31:11.069279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 377219e53ce94ab089e48437d3468663 May 23 15:31:11.069279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-DeleteServersTestJSON-1828795085 May 23 15:31:11.069279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-DeleteServersTestJSON-1828795085-project May 23 15:31:11.069279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:31:11.069279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:31:11.069279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: e91e38a712074ca5a2567da012445aa3 May 23 15:31:11.069279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-DeleteServersTestJSON-1828795085-project May 23 15:31:11.069279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:31:11.069279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:11.069279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '7abcf413-0c08-4f11-b030-2f2f9f09a5a3'} May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:31:11.069918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. May 23 15:31:11.070978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:31:11.072209 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-44255571-2de8-4758-bb1d-54f01417973e tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] Returning 404 to user: Instance 7abcf413-0c08-4f11-b030-2f2f9f09a5a3 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:31:11.072209 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-44255571-2de8-4758-bb1d-54f01417973e tempest-DeleteServersTestJSON-1828795085 tempest-DeleteServersTestJSON-1828795085-project] 10.222.0.30 "GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3" status: 404 len: 111 microversion: 2.1 time: 0.035351 May 23 15:31:11.072209 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 91/182] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:11 2022] GET /compute/v2.1/servers/7abcf413-0c08-4f11-b030-2f2f9f09a5a3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:31:11.558955 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-35a38d9b-ac54-4c63-80c6-1b9aaa477cb5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:11.559577 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-35a38d9b-ac54-4c63-80c6-1b9aaa477cb5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:11.565825 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-35a38d9b-ac54-4c63-80c6-1b9aaa477cb5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:11.566284 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-35a38d9b-ac54-4c63-80c6-1b9aaa477cb5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:11.567050 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-35a38d9b-ac54-4c63-80c6-1b9aaa477cb5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:11.567490 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-35a38d9b-ac54-4c63-80c6-1b9aaa477cb5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:11.709478 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-35a38d9b-ac54-4c63-80c6-1b9aaa477cb5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:11.726222 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-35a38d9b-ac54-4c63-80c6-1b9aaa477cb5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.171110 May 23 15:31:11.727061 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 92/183] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:11 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:12.743637 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-fe0f68e9-4e22-4061-b387-22d7b0c846c0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:12.744793 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-fe0f68e9-4e22-4061-b387-22d7b0c846c0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:12.752067 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fe0f68e9-4e22-4061-b387-22d7b0c846c0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:12.752459 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fe0f68e9-4e22-4061-b387-22d7b0c846c0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:12.753333 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fe0f68e9-4e22-4061-b387-22d7b0c846c0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:12.753806 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fe0f68e9-4e22-4061-b387-22d7b0c846c0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:12.959418 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-fe0f68e9-4e22-4061-b387-22d7b0c846c0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:12.963050 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=100 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:12.969288 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-fe0f68e9-4e22-4061-b387-22d7b0c846c0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.229680 May 23 15:31:12.969854 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 92/184] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:12 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:13.986674 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1ce2790b-7620-43a3-b019-e1a529ea2310 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:13.987299 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-1ce2790b-7620-43a3-b019-e1a529ea2310 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:13.993451 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1ce2790b-7620-43a3-b019-e1a529ea2310 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:13.993926 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1ce2790b-7620-43a3-b019-e1a529ea2310 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:13.994818 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1ce2790b-7620-43a3-b019-e1a529ea2310 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:13.995373 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1ce2790b-7620-43a3-b019-e1a529ea2310 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:14.010965 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=100 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:14.152454 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-1ce2790b-7620-43a3-b019-e1a529ea2310 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:14.162259 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1ce2790b-7620-43a3-b019-e1a529ea2310 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.179428 May 23 15:31:14.164208 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 93/185] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:13 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:15.180948 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-01ecf375-17a1-4fdd-9061-17391d56644a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:15.181569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-01ecf375-17a1-4fdd-9061-17391d56644a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:15.188690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-01ecf375-17a1-4fdd-9061-17391d56644a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:15.189157 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-01ecf375-17a1-4fdd-9061-17391d56644a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:15.189938 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-01ecf375-17a1-4fdd-9061-17391d56644a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:15.190350 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-01ecf375-17a1-4fdd-9061-17391d56644a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:15.328062 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-01ecf375-17a1-4fdd-9061-17391d56644a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:15.335557 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-01ecf375-17a1-4fdd-9061-17391d56644a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.159526 May 23 15:31:15.336124 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 93/186] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:15 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:16.353288 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3c0631d6-f826-4d4e-94e4-0e8d21a9484b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:16.354015 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-3c0631d6-f826-4d4e-94e4-0e8d21a9484b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:16.360771 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3c0631d6-f826-4d4e-94e4-0e8d21a9484b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:16.361287 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3c0631d6-f826-4d4e-94e4-0e8d21a9484b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:16.362085 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3c0631d6-f826-4d4e-94e4-0e8d21a9484b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:16.362529 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3c0631d6-f826-4d4e-94e4-0e8d21a9484b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:16.497409 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3c0631d6-f826-4d4e-94e4-0e8d21a9484b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:16.504887 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-3c0631d6-f826-4d4e-94e4-0e8d21a9484b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.155497 May 23 15:31:16.505466 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 94/187] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:16 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:17.522306 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a08e7f7e-dfca-4c35-9360-ff0a5bcdcc43 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:17.522918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a08e7f7e-dfca-4c35-9360-ff0a5bcdcc43 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:17.529482 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a08e7f7e-dfca-4c35-9360-ff0a5bcdcc43 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:17.529934 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a08e7f7e-dfca-4c35-9360-ff0a5bcdcc43 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:17.530693 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a08e7f7e-dfca-4c35-9360-ff0a5bcdcc43 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:17.531128 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a08e7f7e-dfca-4c35-9360-ff0a5bcdcc43 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:17.667975 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a08e7f7e-dfca-4c35-9360-ff0a5bcdcc43 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:17.675941 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a08e7f7e-dfca-4c35-9360-ff0a5bcdcc43 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.157407 May 23 15:31:17.676512 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 94/188] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:17 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:18.693881 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b38ea6ef-5c3c-4521-bd89-3f612936ef4c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:18.694499 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b38ea6ef-5c3c-4521-bd89-3f612936ef4c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:18.700719 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b38ea6ef-5c3c-4521-bd89-3f612936ef4c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:18.701226 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b38ea6ef-5c3c-4521-bd89-3f612936ef4c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:18.702043 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b38ea6ef-5c3c-4521-bd89-3f612936ef4c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:18.702507 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b38ea6ef-5c3c-4521-bd89-3f612936ef4c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:18.840911 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b38ea6ef-5c3c-4521-bd89-3f612936ef4c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:18.848609 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b38ea6ef-5c3c-4521-bd89-3f612936ef4c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.158743 May 23 15:31:18.849208 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 95/189] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:18 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:19.866666 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ef1a0ced-7806-4a53-8f91-75699124c440 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:19.867512 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ef1a0ced-7806-4a53-8f91-75699124c440 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:19.874745 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ef1a0ced-7806-4a53-8f91-75699124c440 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:19.875188 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ef1a0ced-7806-4a53-8f91-75699124c440 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:19.876194 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ef1a0ced-7806-4a53-8f91-75699124c440 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:19.876641 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ef1a0ced-7806-4a53-8f91-75699124c440 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:20.015945 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ef1a0ced-7806-4a53-8f91-75699124c440 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:20.024192 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ef1a0ced-7806-4a53-8f91-75699124c440 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.161852 May 23 15:31:20.024899 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 95/190] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:19 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:21.044461 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c1b74c6d-97ba-4b17-8907-e804b9517bb3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:21.045425 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c1b74c6d-97ba-4b17-8907-e804b9517bb3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:21.060365 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c1b74c6d-97ba-4b17-8907-e804b9517bb3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:21.061100 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c1b74c6d-97ba-4b17-8907-e804b9517bb3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:21.062063 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c1b74c6d-97ba-4b17-8907-e804b9517bb3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:21.062654 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c1b74c6d-97ba-4b17-8907-e804b9517bb3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:21.251220 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c1b74c6d-97ba-4b17-8907-e804b9517bb3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:21.262997 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c1b74c6d-97ba-4b17-8907-e804b9517bb3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.224434 May 23 15:31:21.263787 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 96/191] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:21 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:22.281132 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3309a1ff-d449-4340-bc2b-4090eb9ad4ed tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:22.282578 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3309a1ff-d449-4340-bc2b-4090eb9ad4ed tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:22.305798 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3309a1ff-d449-4340-bc2b-4090eb9ad4ed tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:22.306391 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3309a1ff-d449-4340-bc2b-4090eb9ad4ed tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:22.307198 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3309a1ff-d449-4340-bc2b-4090eb9ad4ed tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:22.307634 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3309a1ff-d449-4340-bc2b-4090eb9ad4ed tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:22.564034 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3309a1ff-d449-4340-bc2b-4090eb9ad4ed tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:22.574033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3309a1ff-d449-4340-bc2b-4090eb9ad4ed tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.296827 May 23 15:31:22.575110 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 96/192] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:22 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:23.592966 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-0e7b5722-fcf7-42ce-aeed-217c5ea71bc5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:23.594548 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-0e7b5722-fcf7-42ce-aeed-217c5ea71bc5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:23.606737 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0e7b5722-fcf7-42ce-aeed-217c5ea71bc5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:23.607214 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0e7b5722-fcf7-42ce-aeed-217c5ea71bc5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:23.608032 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0e7b5722-fcf7-42ce-aeed-217c5ea71bc5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:23.608474 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0e7b5722-fcf7-42ce-aeed-217c5ea71bc5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:23.906369 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-0e7b5722-fcf7-42ce-aeed-217c5ea71bc5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:23.914335 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-0e7b5722-fcf7-42ce-aeed-217c5ea71bc5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.326276 May 23 15:31:23.915625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 97/193] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:23 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:24.933555 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e43b48ef-04b7-464b-bd65-4953e4957d1d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:24.935037 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e43b48ef-04b7-464b-bd65-4953e4957d1d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:24.942555 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e43b48ef-04b7-464b-bd65-4953e4957d1d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:24.943483 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e43b48ef-04b7-464b-bd65-4953e4957d1d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:24.944515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e43b48ef-04b7-464b-bd65-4953e4957d1d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:24.945303 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e43b48ef-04b7-464b-bd65-4953e4957d1d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:25.150928 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e43b48ef-04b7-464b-bd65-4953e4957d1d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:25.159139 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e43b48ef-04b7-464b-bd65-4953e4957d1d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.229538 May 23 15:31:25.169067 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 97/194] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:24 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:26.175686 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7fae0d52-f1d5-4a2b-8417-701964bd70ba tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:26.176412 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7fae0d52-f1d5-4a2b-8417-701964bd70ba tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:26.185011 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7fae0d52-f1d5-4a2b-8417-701964bd70ba tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:26.185471 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7fae0d52-f1d5-4a2b-8417-701964bd70ba tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:26.186268 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7fae0d52-f1d5-4a2b-8417-701964bd70ba tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:26.186715 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7fae0d52-f1d5-4a2b-8417-701964bd70ba tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:26.440591 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-7fae0d52-f1d5-4a2b-8417-701964bd70ba tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:26.454356 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7fae0d52-f1d5-4a2b-8417-701964bd70ba tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.282525 May 23 15:31:26.455114 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 98/195] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:26 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:27.471201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-189e6b22-9290-45a9-85e3-3e2bf5ad15df tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:27.472562 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-189e6b22-9290-45a9-85e3-3e2bf5ad15df tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:27.481647 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-189e6b22-9290-45a9-85e3-3e2bf5ad15df tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:27.482357 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-189e6b22-9290-45a9-85e3-3e2bf5ad15df tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:27.483520 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-189e6b22-9290-45a9-85e3-3e2bf5ad15df tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:27.484318 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-189e6b22-9290-45a9-85e3-3e2bf5ad15df tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:27.710502 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-189e6b22-9290-45a9-85e3-3e2bf5ad15df tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:27.720310 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-189e6b22-9290-45a9-85e3-3e2bf5ad15df tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.253233 May 23 15:31:27.721196 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 98/196] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:27 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:28.739733 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-987edec5-6057-4cac-bbd7-2fc95970436c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:28.741530 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-987edec5-6057-4cac-bbd7-2fc95970436c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:28.753907 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-987edec5-6057-4cac-bbd7-2fc95970436c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:28.754733 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-987edec5-6057-4cac-bbd7-2fc95970436c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:28.755828 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-987edec5-6057-4cac-bbd7-2fc95970436c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:28.756536 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-987edec5-6057-4cac-bbd7-2fc95970436c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:28.939163 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-987edec5-6057-4cac-bbd7-2fc95970436c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:28.950661 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-987edec5-6057-4cac-bbd7-2fc95970436c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.216290 May 23 15:31:28.951368 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 99/197] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:28 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:29.969654 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-860ae380-e611-481a-b632-aa2ab1aea2e3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:29.971251 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-860ae380-e611-481a-b632-aa2ab1aea2e3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:29.991478 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-860ae380-e611-481a-b632-aa2ab1aea2e3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:29.996001 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-860ae380-e611-481a-b632-aa2ab1aea2e3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:29.997141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-860ae380-e611-481a-b632-aa2ab1aea2e3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:29.998372 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-860ae380-e611-481a-b632-aa2ab1aea2e3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:30.292191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-860ae380-e611-481a-b632-aa2ab1aea2e3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:30.303765 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-860ae380-e611-481a-b632-aa2ab1aea2e3 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.340034 May 23 15:31:30.320390 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 99/198] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:29 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:31.328539 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b15e1ced-bc8c-4329-819b-ea61973b05cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:31.329443 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b15e1ced-bc8c-4329-819b-ea61973b05cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:31.362191 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b15e1ced-bc8c-4329-819b-ea61973b05cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:31.362718 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b15e1ced-bc8c-4329-819b-ea61973b05cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:31.363980 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b15e1ced-bc8c-4329-819b-ea61973b05cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:31.364421 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b15e1ced-bc8c-4329-819b-ea61973b05cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:31.695067 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b15e1ced-bc8c-4329-819b-ea61973b05cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:31.720355 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b15e1ced-bc8c-4329-819b-ea61973b05cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.387532 May 23 15:31:31.729425 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 100/199] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:31 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:32.741148 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f0555788-fef9-4fae-b57a-6a08098c7eaf tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:32.741693 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f0555788-fef9-4fae-b57a-6a08098c7eaf tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:32.755421 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f0555788-fef9-4fae-b57a-6a08098c7eaf tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:32.756136 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f0555788-fef9-4fae-b57a-6a08098c7eaf tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:32.757729 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f0555788-fef9-4fae-b57a-6a08098c7eaf tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:32.758321 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f0555788-fef9-4fae-b57a-6a08098c7eaf tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:32.958211 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-f0555788-fef9-4fae-b57a-6a08098c7eaf tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:32.967636 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f0555788-fef9-4fae-b57a-6a08098c7eaf tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.231802 May 23 15:31:32.969557 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 100/200] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:32 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:33.994466 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-66886119-7d20-4dc6-8871-d33253ebe82d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:33.995148 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-66886119-7d20-4dc6-8871-d33253ebe82d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:34.043815 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-66886119-7d20-4dc6-8871-d33253ebe82d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:34.044282 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-66886119-7d20-4dc6-8871-d33253ebe82d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:34.045119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-66886119-7d20-4dc6-8871-d33253ebe82d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:34.045558 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-66886119-7d20-4dc6-8871-d33253ebe82d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:34.260699 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-66886119-7d20-4dc6-8871-d33253ebe82d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:34.271656 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-66886119-7d20-4dc6-8871-d33253ebe82d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.288779 May 23 15:31:34.272542 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 101/201] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:33 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:35.289816 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-26707946-2d45-4297-90e3-9c8823ddc1a8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:35.290447 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-26707946-2d45-4297-90e3-9c8823ddc1a8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:35.298150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-26707946-2d45-4297-90e3-9c8823ddc1a8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:35.298599 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-26707946-2d45-4297-90e3-9c8823ddc1a8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:35.300199 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-26707946-2d45-4297-90e3-9c8823ddc1a8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:35.301312 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-26707946-2d45-4297-90e3-9c8823ddc1a8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:35.610195 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-26707946-2d45-4297-90e3-9c8823ddc1a8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:35.627243 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-26707946-2d45-4297-90e3-9c8823ddc1a8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.340899 May 23 15:31:35.629575 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 101/202] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:35 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:36.647661 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-10edaba7-19d7-48fb-984c-f9864406480f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:36.648353 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-10edaba7-19d7-48fb-984c-f9864406480f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:36.659856 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-10edaba7-19d7-48fb-984c-f9864406480f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:36.660388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-10edaba7-19d7-48fb-984c-f9864406480f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:36.662807 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-10edaba7-19d7-48fb-984c-f9864406480f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:36.663631 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-10edaba7-19d7-48fb-984c-f9864406480f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:37.017082 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-10edaba7-19d7-48fb-984c-f9864406480f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:37.028302 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-10edaba7-19d7-48fb-984c-f9864406480f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1521 microversion: 2.1 time: 0.384389 May 23 15:31:37.031275 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 102/203] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:36 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:38.049510 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-7c314916-84af-41c8-9701-7b7b416d4856 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:38.050342 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-7c314916-84af-41c8-9701-7b7b416d4856 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:38.067149 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7c314916-84af-41c8-9701-7b7b416d4856 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:38.067966 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7c314916-84af-41c8-9701-7b7b416d4856 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:38.069061 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7c314916-84af-41c8-9701-7b7b416d4856 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:38.069658 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7c314916-84af-41c8-9701-7b7b416d4856 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:38.268167 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-7c314916-84af-41c8-9701-7b7b416d4856 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:38.279338 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-7c314916-84af-41c8-9701-7b7b416d4856 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1501 microversion: 2.1 time: 0.234496 May 23 15:31:38.280700 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 102/204] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:38 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1501 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:38.296201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d8fa770a-2cc0-48d1-80d5-a578cb08a823 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:38.297431 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d8fa770a-2cc0-48d1-80d5-a578cb08a823 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:38.308693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=30 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:38.310925 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d8fa770a-2cc0-48d1-80d5-a578cb08a823 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:38.311646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d8fa770a-2cc0-48d1-80d5-a578cb08a823 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:38.312678 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d8fa770a-2cc0-48d1-80d5-a578cb08a823 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:38.313485 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d8fa770a-2cc0-48d1-80d5-a578cb08a823 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:38.518372 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d8fa770a-2cc0-48d1-80d5-a578cb08a823 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:38.528615 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d8fa770a-2cc0-48d1-80d5-a578cb08a823 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1517 microversion: 2.1 time: 0.236715 May 23 15:31:38.529743 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 103/205] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:38 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1517 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:40.361737 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-1af15087-97a4-44d6-983c-e4a505e08191 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:31:40.363657 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-1af15087-97a4-44d6-983c-e4a505e08191 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:40.401566 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1af15087-97a4-44d6-983c-e4a505e08191 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:40.403075 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1af15087-97a4-44d6-983c-e4a505e08191 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:40.405620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1af15087-97a4-44d6-983c-e4a505e08191 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:40.406229 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1af15087-97a4-44d6-983c-e4a505e08191 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:40.450698 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-1af15087-97a4-44d6-983c-e4a505e08191 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lazy-loading 'flavor' on Instance uuid 40f940d7-a17e-4271-9326-70a868f80e59 {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:31:40.583779 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-1af15087-97a4-44d6-983c-e4a505e08191 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "POST /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59/action" status: 200 len: 32 microversion: 2.1 time: 0.236572 May 23 15:31:40.584684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 103/206] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 15:31:40 2022] POST /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59/action => generated 32 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:31:40.600053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ba021a3c-d91c-48f7-bd86-31b4625e2eb2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:40.602650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ba021a3c-d91c-48f7-bd86-31b4625e2eb2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:40.621754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ba021a3c-d91c-48f7-bd86-31b4625e2eb2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:40.622286 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ba021a3c-d91c-48f7-bd86-31b4625e2eb2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:40.623116 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ba021a3c-d91c-48f7-bd86-31b4625e2eb2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:40.623710 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ba021a3c-d91c-48f7-bd86-31b4625e2eb2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:40.893452 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ba021a3c-d91c-48f7-bd86-31b4625e2eb2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:40.905723 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ba021a3c-d91c-48f7-bd86-31b4625e2eb2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.315716 May 23 15:31:40.906683 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 104/207] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:40 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:41.072129 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-6df0d7ac-cdf8-42ba-8bd0-7519bc5d9474 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:41.072129 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-6df0d7ac-cdf8-42ba-8bd0-7519bc5d9474 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:41.074361 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=26 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:41.086607 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6df0d7ac-cdf8-42ba-8bd0-7519bc5d9474 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:41.091304 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6df0d7ac-cdf8-42ba-8bd0-7519bc5d9474 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:41.092602 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6df0d7ac-cdf8-42ba-8bd0-7519bc5d9474 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:41.093150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6df0d7ac-cdf8-42ba-8bd0-7519bc5d9474 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:41.134826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-6df0d7ac-cdf8-42ba-8bd0-7519bc5d9474 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/ips" status: 200 len: 151 microversion: 2.20 time: 0.067903 May 23 15:31:41.138935 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 104/208] 10.222.0.30 () {60 vars in 1288 bytes} [Mon May 23 15:31:41 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/ips => generated 151 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:31:41.926148 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-0d7e5c3f-2fe7-4715-8d14-7a70fee5832d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:41.927624 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-0d7e5c3f-2fe7-4715-8d14-7a70fee5832d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:41.940295 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0d7e5c3f-2fe7-4715-8d14-7a70fee5832d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:41.941101 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0d7e5c3f-2fe7-4715-8d14-7a70fee5832d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:41.941940 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0d7e5c3f-2fe7-4715-8d14-7a70fee5832d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:41.942754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0d7e5c3f-2fe7-4715-8d14-7a70fee5832d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:42.150364 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-0d7e5c3f-2fe7-4715-8d14-7a70fee5832d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:42.159238 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-0d7e5c3f-2fe7-4715-8d14-7a70fee5832d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.237251 May 23 15:31:42.159835 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 105/209] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:41 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:43.177412 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-356f1b40-31a6-43f4-8ba7-ec52b0c07d41 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:43.178042 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-356f1b40-31a6-43f4-8ba7-ec52b0c07d41 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:43.192398 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-356f1b40-31a6-43f4-8ba7-ec52b0c07d41 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:43.192398 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-356f1b40-31a6-43f4-8ba7-ec52b0c07d41 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:43.192758 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-356f1b40-31a6-43f4-8ba7-ec52b0c07d41 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:43.193208 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-356f1b40-31a6-43f4-8ba7-ec52b0c07d41 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:43.381681 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-356f1b40-31a6-43f4-8ba7-ec52b0c07d41 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:43.394533 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-356f1b40-31a6-43f4-8ba7-ec52b0c07d41 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.220884 May 23 15:31:43.395367 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 105/210] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:43 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:44.413125 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-710769a1-ed05-43aa-bc41-066471395b9b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:44.415183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-710769a1-ed05-43aa-bc41-066471395b9b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:44.421718 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-710769a1-ed05-43aa-bc41-066471395b9b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:44.422622 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-710769a1-ed05-43aa-bc41-066471395b9b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:44.424763 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-710769a1-ed05-43aa-bc41-066471395b9b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:44.425861 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-710769a1-ed05-43aa-bc41-066471395b9b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:44.433375 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=78 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:44.531278 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-90a5f2f2-48b0-4571-8614-0e589b2e7cdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:31:44.531858 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-90a5f2f2-48b0-4571-8614-0e589b2e7cdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:44.544703 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-90a5f2f2-48b0-4571-8614-0e589b2e7cdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:44.549650 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-90a5f2f2-48b0-4571-8614-0e589b2e7cdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:44.550987 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-90a5f2f2-48b0-4571-8614-0e589b2e7cdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:44.551591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-90a5f2f2-48b0-4571-8614-0e589b2e7cdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:44.588011 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-90a5f2f2-48b0-4571-8614-0e589b2e7cdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lazy-loading 'flavor' on Instance uuid 9b9038c8-1395-4d48-b10b-2fe7310c4c76 {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:31:44.628288 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-710769a1-ed05-43aa-bc41-066471395b9b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:44.642843 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-710769a1-ed05-43aa-bc41-066471395b9b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.233927 May 23 15:31:44.643582 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 106/211] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:44 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:44.678095 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:45.660017 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b71c467c-6b88-4298-ace0-94f18409de17 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:45.661464 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b71c467c-6b88-4298-ace0-94f18409de17 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:45.671774 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b71c467c-6b88-4298-ace0-94f18409de17 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:45.672703 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b71c467c-6b88-4298-ace0-94f18409de17 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:45.673682 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b71c467c-6b88-4298-ace0-94f18409de17 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:45.674323 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b71c467c-6b88-4298-ace0-94f18409de17 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:45.932207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b71c467c-6b88-4298-ace0-94f18409de17 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:45.950321 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b71c467c-6b88-4298-ace0-94f18409de17 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.294412 May 23 15:31:45.951234 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 107/212] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:45 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:31:46.968655 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-99ce804f-641d-4fea-bbc1-9a6506d64b99 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:46.970479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-99ce804f-641d-4fea-bbc1-9a6506d64b99 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:46.977104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-99ce804f-641d-4fea-bbc1-9a6506d64b99 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:46.977654 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-99ce804f-641d-4fea-bbc1-9a6506d64b99 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:46.978524 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-99ce804f-641d-4fea-bbc1-9a6506d64b99 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:46.979215 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-99ce804f-641d-4fea-bbc1-9a6506d64b99 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:47.146193 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-99ce804f-641d-4fea-bbc1-9a6506d64b99 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:47.155578 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-99ce804f-641d-4fea-bbc1-9a6506d64b99 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.191739 May 23 15:31:47.167483 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 108/213] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:46 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:47.175068 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-db15261c-add1-47b8-b3b3-84c6d4918eba tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Action: 'create', calling method: .version_select at 0x7f0d7adb5160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-984145697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmsNxel6S4cZFZ9d9gfJMU98KmqT3ecVtlfFxm16zC0VDsPZAOJQ+PwqqnLj/N86Oz2wk+RFFOGtaPge7XYHln6yEiXke6fQNPzGxVwI/7U5qGWNa7oGzxrR3DJcPQQNQ=="}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:31:47.199363 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-db15261c-add1-47b8-b3b3-84c6d4918eba tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Getting quotas for project 591802cf5c044932940307866f388790. Resources: {'key_pairs'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:31:47.204793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-db15261c-add1-47b8-b3b3-84c6d4918eba tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Getting quotas for user ceed468da0c844b688f5f91768b0dd96 and project 591802cf5c044932940307866f388790. Resources: {'key_pairs'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:31:47.251351 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-db15261c-add1-47b8-b3b3-84c6d4918eba tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.080261 May 23 15:31:47.252229 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 109/214] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 15:31:47 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:31:47.458205 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-adbbb73e-7895-4862-b40a-d4108c4dd0fe tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1184199810", "imageRef": "6355bf41-fbb3-4cd5-a99f-e1f256b5ec73", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-984145697", "networks": [{"uuid": "209a8533-2c3a-4df0-b96f-8327ce97789f"}]}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:31:47.509651 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-90a5f2f2-48b0-4571-8614-0e589b2e7cdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "POST /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/action" status: 202 len: 0 microversion: 2.20 time: 2.983274 May 23 15:31:47.510552 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 106/215] 10.222.0.30 () {62 vars in 1318 bytes} [Mon May 23 15:31:44 2022] POST /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/action => generated 0 bytes in 2985 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 15:31:47.540216 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-71e52476-0b5f-4031-a1d0-6fd206b36448 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:47.541032 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-71e52476-0b5f-4031-a1d0-6fd206b36448 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:47.549643 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-71e52476-0b5f-4031-a1d0-6fd206b36448 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:47.550095 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-71e52476-0b5f-4031-a1d0-6fd206b36448 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:47.550871 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-71e52476-0b5f-4031-a1d0-6fd206b36448 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:47.551312 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-71e52476-0b5f-4031-a1d0-6fd206b36448 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:47.558869 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.network.neutron [None req-adbbb73e-7895-4862-b40a-d4108c4dd0fe tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] validate_networks() for [('209a8533-2c3a-4df0-b96f-8327ce97789f', None, None, None, None, None)] {{(pid=117973) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:31:47.749422 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-71e52476-0b5f-4031-a1d0-6fd206b36448 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:47.759451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-71e52476-0b5f-4031-a1d0-6fd206b36448 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:47.762093 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-71e52476-0b5f-4031-a1d0-6fd206b36448 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:47.765595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-71e52476-0b5f-4031-a1d0-6fd206b36448 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.233859 May 23 15:31:47.783563 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 107/216] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:31:47 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:31:48.056696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-adbbb73e-7895-4862-b40a-d4108c4dd0fe tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Flavor limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:31:48.057179 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-adbbb73e-7895-4862-b40a-d4108c4dd0fe tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Image limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:31:48.057624 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-adbbb73e-7895-4862-b40a-d4108c4dd0fe tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Flavor pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:31:48.058260 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-adbbb73e-7895-4862-b40a-d4108c4dd0fe tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Image pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:31:48.059245 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-adbbb73e-7895-4862-b40a-d4108c4dd0fe tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:31:48.069568 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-adbbb73e-7895-4862-b40a-d4108c4dd0fe tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:48.070025 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-adbbb73e-7895-4862-b40a-d4108c4dd0fe tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:48.070818 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-adbbb73e-7895-4862-b40a-d4108c4dd0fe tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:48.071392 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-adbbb73e-7895-4862-b40a-d4108c4dd0fe tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:48.091598 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-adbbb73e-7895-4862-b40a-d4108c4dd0fe tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Getting quotas for project 591802cf5c044932940307866f388790. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:31:48.096278 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-adbbb73e-7895-4862-b40a-d4108c4dd0fe tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Getting quotas for user ceed468da0c844b688f5f91768b0dd96 and project 591802cf5c044932940307866f388790. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:31:48.109832 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-adbbb73e-7895-4862-b40a-d4108c4dd0fe tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Going to run 1 instances... {{(pid=117973) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:31:48.112526 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-adbbb73e-7895-4862-b40a-d4108c4dd0fe tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6355bf41-fbb3-4cd5-a99f-e1f256b5ec73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:31:48.173600 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-edcba2ac-b337-43a4-98da-7f4535646855 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:48.174321 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-edcba2ac-b337-43a4-98da-7f4535646855 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:48.177461 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-adbbb73e-7895-4862-b40a-d4108c4dd0fe tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715450 May 23 15:31:48.181305 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 110/217] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:31:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:31:48.182753 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-edcba2ac-b337-43a4-98da-7f4535646855 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:48.183808 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-edcba2ac-b337-43a4-98da-7f4535646855 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:48.184953 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-edcba2ac-b337-43a4-98da-7f4535646855 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:48.185602 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-edcba2ac-b337-43a4-98da-7f4535646855 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:48.191583 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-9d4498a4-d2e3-4b50-be4e-7dc970914bd6 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:48.195304 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-9d4498a4-d2e3-4b50-be4e-7dc970914bd6 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:48.273406 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9d4498a4-d2e3-4b50-be4e-7dc970914bd6 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:48.280209 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-9d4498a4-d2e3-4b50-be4e-7dc970914bd6 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1258 microversion: 2.1 time: 0.092914 May 23 15:31:48.280786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 111/218] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:48 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1258 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:31:48.444340 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-edcba2ac-b337-43a4-98da-7f4535646855 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:48.455314 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-edcba2ac-b337-43a4-98da-7f4535646855 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.284292 May 23 15:31:48.457182 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 108/219] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:48 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:31:48.790031 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-20b7f166-f0dc-4224-9ed1-f3b8f6e29fdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:48.790786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-20b7f166-f0dc-4224-9ed1-f3b8f6e29fdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:48.797742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-20b7f166-f0dc-4224-9ed1-f3b8f6e29fdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:48.798243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-20b7f166-f0dc-4224-9ed1-f3b8f6e29fdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:48.802527 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-20b7f166-f0dc-4224-9ed1-f3b8f6e29fdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:48.802982 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-20b7f166-f0dc-4224-9ed1-f3b8f6e29fdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:48.954826 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-20b7f166-f0dc-4224-9ed1-f3b8f6e29fdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:48.971516 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-20b7f166-f0dc-4224-9ed1-f3b8f6e29fdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:48.974462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-20b7f166-f0dc-4224-9ed1-f3b8f6e29fdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:48.975794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-20b7f166-f0dc-4224-9ed1-f3b8f6e29fdd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.189797 May 23 15:31:48.976906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 112/220] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:31:48 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:31:49.297944 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-0fea6e2b-8ac8-42cc-9489-5b7460028f8c tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:49.298571 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-0fea6e2b-8ac8-42cc-9489-5b7460028f8c tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:49.305567 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fea6e2b-8ac8-42cc-9489-5b7460028f8c tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:49.305934 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fea6e2b-8ac8-42cc-9489-5b7460028f8c tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:49.306707 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fea6e2b-8ac8-42cc-9489-5b7460028f8c tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:49.307149 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fea6e2b-8ac8-42cc-9489-5b7460028f8c tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:49.371270 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0fea6e2b-8ac8-42cc-9489-5b7460028f8c tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:49.378658 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-0fea6e2b-8ac8-42cc-9489-5b7460028f8c tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1310 microversion: 2.1 time: 0.084653 May 23 15:31:49.379230 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 109/221] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:49 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:49.473137 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-85020650-166d-43c9-afe4-c747e2bd58d6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:49.473759 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-85020650-166d-43c9-afe4-c747e2bd58d6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:49.482441 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-85020650-166d-43c9-afe4-c747e2bd58d6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:49.482851 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-85020650-166d-43c9-afe4-c747e2bd58d6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:49.483630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-85020650-166d-43c9-afe4-c747e2bd58d6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:49.484068 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-85020650-166d-43c9-afe4-c747e2bd58d6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:49.726417 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-85020650-166d-43c9-afe4-c747e2bd58d6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:49.735327 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-85020650-166d-43c9-afe4-c747e2bd58d6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.265999 May 23 15:31:49.736201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 113/222] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:49 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:49.998370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-bc46fc1c-36cd-492b-83fa-d4c82594c9f2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:49.999008 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-bc46fc1c-36cd-492b-83fa-d4c82594c9f2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:50.005782 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bc46fc1c-36cd-492b-83fa-d4c82594c9f2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:50.006235 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bc46fc1c-36cd-492b-83fa-d4c82594c9f2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:50.007230 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bc46fc1c-36cd-492b-83fa-d4c82594c9f2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:50.007700 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bc46fc1c-36cd-492b-83fa-d4c82594c9f2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:50.196319 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-bc46fc1c-36cd-492b-83fa-d4c82594c9f2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:50.208764 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-bc46fc1c-36cd-492b-83fa-d4c82594c9f2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:50.210739 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-bc46fc1c-36cd-492b-83fa-d4c82594c9f2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:50.212305 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-bc46fc1c-36cd-492b-83fa-d4c82594c9f2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.221671 May 23 15:31:50.213714 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 110/223] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:31:49 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:31:50.397647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-2f37740c-3d2d-4691-86b2-de206a010edc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:50.398351 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-2f37740c-3d2d-4691-86b2-de206a010edc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:50.408119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2f37740c-3d2d-4691-86b2-de206a010edc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:50.408602 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2f37740c-3d2d-4691-86b2-de206a010edc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:50.412329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2f37740c-3d2d-4691-86b2-de206a010edc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:50.412818 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2f37740c-3d2d-4691-86b2-de206a010edc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:50.654191 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-2f37740c-3d2d-4691-86b2-de206a010edc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:50.662858 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-2f37740c-3d2d-4691-86b2-de206a010edc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.269689 May 23 15:31:50.663591 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 114/224] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:50 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:31:50.705482 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-0c9b91b5-06bb-4cae-98e4-43d0823722ec tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:50.706015 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-0c9b91b5-06bb-4cae-98e4-43d0823722ec tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:50.712422 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0c9b91b5-06bb-4cae-98e4-43d0823722ec tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:50.712965 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0c9b91b5-06bb-4cae-98e4-43d0823722ec tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:50.713780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0c9b91b5-06bb-4cae-98e4-43d0823722ec tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:50.714749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0c9b91b5-06bb-4cae-98e4-43d0823722ec tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:50.739722 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-0c9b91b5-06bb-4cae-98e4-43d0823722ec tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/ips" status: 200 len: 145 microversion: 2.1 time: 0.038163 May 23 15:31:50.740297 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 111/225] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 15:31:50 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:31:50.751868 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3439d154-4d5a-4a99-a427-40ff2293a7dd tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:50.752474 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-3439d154-4d5a-4a99-a427-40ff2293a7dd tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:50.758521 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3439d154-4d5a-4a99-a427-40ff2293a7dd tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:50.759156 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3439d154-4d5a-4a99-a427-40ff2293a7dd tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:50.759913 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3439d154-4d5a-4a99-a427-40ff2293a7dd tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:50.760431 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3439d154-4d5a-4a99-a427-40ff2293a7dd tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:50.971699 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3439d154-4d5a-4a99-a427-40ff2293a7dd tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:50.979211 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-3439d154-4d5a-4a99-a427-40ff2293a7dd tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.231465 May 23 15:31:50.980302 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 115/226] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:50 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:51.016085 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-cbeed040-246f-4fba-a9fe-ac11520eb649 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:51.016672 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-cbeed040-246f-4fba-a9fe-ac11520eb649 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:51.023517 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-cbeed040-246f-4fba-a9fe-ac11520eb649 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:51.024057 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-cbeed040-246f-4fba-a9fe-ac11520eb649 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:51.025020 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-cbeed040-246f-4fba-a9fe-ac11520eb649 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:51.025529 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-cbeed040-246f-4fba-a9fe-ac11520eb649 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:51.050313 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-cbeed040-246f-4fba-a9fe-ac11520eb649 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e/ips" status: 200 len: 148 microversion: 2.1 time: 0.038378 May 23 15:31:51.050906 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 112/227] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 15:31:51 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:31:51.243160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-9f9d2534-49ba-4eec-bd4d-787d5712d4ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:51.244012 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-9f9d2534-49ba-4eec-bd4d-787d5712d4ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:51.255494 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9f9d2534-49ba-4eec-bd4d-787d5712d4ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:51.258276 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9f9d2534-49ba-4eec-bd4d-787d5712d4ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:51.260764 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9f9d2534-49ba-4eec-bd4d-787d5712d4ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:51.271215 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9f9d2534-49ba-4eec-bd4d-787d5712d4ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:51.437163 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-21caf033-dcd4-41ed-89ed-f14ca4241745 req-97735a2c-5b31-4d61-bba9-78d8273fc8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55f39cba-5943-42d5-9322-58f3af0d39f8", "tag": "d674721e-f3c3-41d6-99a3-5276229c8c17"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:31:51.469598 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-21caf033-dcd4-41ed-89ed-f14ca4241745 req-97735a2c-5b31-4d61-bba9-78d8273fc8d1 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:51.470391 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-21caf033-dcd4-41ed-89ed-f14ca4241745 req-97735a2c-5b31-4d61-bba9-78d8273fc8d1 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:51.516769 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-21caf033-dcd4-41ed-89ed-f14ca4241745 req-97735a2c-5b31-4d61-bba9-78d8273fc8d1 service nova] Creating event network-changed:d674721e-f3c3-41d6-99a3-5276229c8c17 for instance 55f39cba-5943-42d5-9322-58f3af0d39f8 on hv-cinder-84112 May 23 15:31:51.530299 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-21caf033-dcd4-41ed-89ed-f14ca4241745 req-97735a2c-5b31-4d61-bba9-78d8273fc8d1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100191 May 23 15:31:51.531211 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 113/228] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:31:51.613298 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9f9d2534-49ba-4eec-bd4d-787d5712d4ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:51.631315 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9f9d2534-49ba-4eec-bd4d-787d5712d4ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:51.632916 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9f9d2534-49ba-4eec-bd4d-787d5712d4ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:51.634144 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-9f9d2534-49ba-4eec-bd4d-787d5712d4ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.406395 May 23 15:31:51.644901 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 116/229] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:31:51 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:31:51.680827 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-20de0bbd-0cf2-44ef-bf66-2b56815f4624 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:51.681569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-20de0bbd-0cf2-44ef-bf66-2b56815f4624 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:51.688108 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-20de0bbd-0cf2-44ef-bf66-2b56815f4624 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:51.690888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-20de0bbd-0cf2-44ef-bf66-2b56815f4624 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:51.691796 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-20de0bbd-0cf2-44ef-bf66-2b56815f4624 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:51.692423 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-20de0bbd-0cf2-44ef-bf66-2b56815f4624 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:51.856501 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-20de0bbd-0cf2-44ef-bf66-2b56815f4624 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:51.864258 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-20de0bbd-0cf2-44ef-bf66-2b56815f4624 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.187740 May 23 15:31:51.865141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 114/230] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:51 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:51.996936 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a8e26bd2-a9d6-46e5-8da0-37ffb2fb8e64 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:51.997464 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-a8e26bd2-a9d6-46e5-8da0-37ffb2fb8e64 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:52.003431 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a8e26bd2-a9d6-46e5-8da0-37ffb2fb8e64 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:52.003887 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a8e26bd2-a9d6-46e5-8da0-37ffb2fb8e64 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:52.004659 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a8e26bd2-a9d6-46e5-8da0-37ffb2fb8e64 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:52.005126 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a8e26bd2-a9d6-46e5-8da0-37ffb2fb8e64 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:52.153125 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a8e26bd2-a9d6-46e5-8da0-37ffb2fb8e64 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:52.166694 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a8e26bd2-a9d6-46e5-8da0-37ffb2fb8e64 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.174300 May 23 15:31:52.167529 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 117/231] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:51 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:52.574285 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e6bd5261-1e37-485c-a801-b6ca1045ce61 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ece2194-5ae3-41dd-8093-100a4148172a"}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:31:52.575483 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e6bd5261-1e37-485c-a801-b6ca1045ce61 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:52.581978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e6bd5261-1e37-485c-a801-b6ca1045ce61 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:52.582431 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e6bd5261-1e37-485c-a801-b6ca1045ce61 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:52.583230 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e6bd5261-1e37-485c-a801-b6ca1045ce61 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:52.583669 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e6bd5261-1e37-485c-a801-b6ca1045ce61 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:52.654407 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-aafdcf55-d1b6-4fd5-9ec0-d5a3d8f7803e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:52.655321 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-aafdcf55-d1b6-4fd5-9ec0-d5a3d8f7803e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:52.662756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-aafdcf55-d1b6-4fd5-9ec0-d5a3d8f7803e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:52.663269 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-aafdcf55-d1b6-4fd5-9ec0-d5a3d8f7803e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:52.664123 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-aafdcf55-d1b6-4fd5-9ec0-d5a3d8f7803e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:52.664838 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-aafdcf55-d1b6-4fd5-9ec0-d5a3d8f7803e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:52.960184 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-aafdcf55-d1b6-4fd5-9ec0-d5a3d8f7803e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:52.992386 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-aafdcf55-d1b6-4fd5-9ec0-d5a3d8f7803e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:52.995616 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-aafdcf55-d1b6-4fd5-9ec0-d5a3d8f7803e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:52.996957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-aafdcf55-d1b6-4fd5-9ec0-d5a3d8f7803e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.346589 May 23 15:31:52.999451 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 118/232] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:31:52 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:31:53.006689 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3e7b0f66-79fe-4b9d-93a2-146aacf4a71c tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:53.007312 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-3e7b0f66-79fe-4b9d-93a2-146aacf4a71c tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:53.016212 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3e7b0f66-79fe-4b9d-93a2-146aacf4a71c tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:53.016891 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3e7b0f66-79fe-4b9d-93a2-146aacf4a71c tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:53.017682 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3e7b0f66-79fe-4b9d-93a2-146aacf4a71c tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:53.018119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3e7b0f66-79fe-4b9d-93a2-146aacf4a71c tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:53.020459 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e6bd5261-1e37-485c-a801-b6ca1045ce61 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "POST /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.449521 May 23 15:31:53.021328 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 115/233] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 15:31:52 2022] POST /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e/os-volume_attachments => generated 194 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:31:53.185431 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f299a749-56b0-4815-8951-5601240dd53e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:53.186148 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3e7b0f66-79fe-4b9d-93a2-146aacf4a71c tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:53.186656 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f299a749-56b0-4815-8951-5601240dd53e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:53.194877 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-3e7b0f66-79fe-4b9d-93a2-146aacf4a71c tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.194246 May 23 15:31:53.196630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 119/234] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:52 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:53.209135 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f299a749-56b0-4815-8951-5601240dd53e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:53.209790 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f299a749-56b0-4815-8951-5601240dd53e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:53.210729 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f299a749-56b0-4815-8951-5601240dd53e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:53.211179 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f299a749-56b0-4815-8951-5601240dd53e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:53.429218 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-f299a749-56b0-4815-8951-5601240dd53e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:53.437628 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f299a749-56b0-4815-8951-5601240dd53e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.257199 May 23 15:31:53.438209 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 116/235] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:53 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:31:54.017587 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c91d8e4c-8ba7-45a0-86c1-e0596b37f7e0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:54.018212 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c91d8e4c-8ba7-45a0-86c1-e0596b37f7e0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:54.024776 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c91d8e4c-8ba7-45a0-86c1-e0596b37f7e0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:54.025265 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c91d8e4c-8ba7-45a0-86c1-e0596b37f7e0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:54.026050 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c91d8e4c-8ba7-45a0-86c1-e0596b37f7e0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:54.027266 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c91d8e4c-8ba7-45a0-86c1-e0596b37f7e0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:54.176401 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c91d8e4c-8ba7-45a0-86c1-e0596b37f7e0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:54.185287 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c91d8e4c-8ba7-45a0-86c1-e0596b37f7e0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:54.187572 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c91d8e4c-8ba7-45a0-86c1-e0596b37f7e0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:54.188820 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c91d8e4c-8ba7-45a0-86c1-e0596b37f7e0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.175174 May 23 15:31:54.189548 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 120/236] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:31:54 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:31:54.215848 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-96684dd7-644c-42ef-8e9d-c30f19433dda tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:54.215848 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-96684dd7-644c-42ef-8e9d-c30f19433dda tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:54.225541 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96684dd7-644c-42ef-8e9d-c30f19433dda tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:54.226070 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96684dd7-644c-42ef-8e9d-c30f19433dda tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:54.227010 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96684dd7-644c-42ef-8e9d-c30f19433dda tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:54.227460 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96684dd7-644c-42ef-8e9d-c30f19433dda tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:54.440459 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-21024846-6c97-4a32-b041-3519fa10951c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a96c7e0a-2507-4d1c-b096-edba6655ac9f"}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:31:54.441663 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-21024846-6c97-4a32-b041-3519fa10951c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:54.457451 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-21024846-6c97-4a32-b041-3519fa10951c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:54.458016 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-21024846-6c97-4a32-b041-3519fa10951c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:54.461171 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-21024846-6c97-4a32-b041-3519fa10951c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:54.462823 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-21024846-6c97-4a32-b041-3519fa10951c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:54.612549 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-96684dd7-644c-42ef-8e9d-c30f19433dda tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:54.621164 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-96684dd7-644c-42ef-8e9d-c30f19433dda tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.410419 May 23 15:31:54.622063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 117/237] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:54 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:54.629179 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-50e7dc68-0ed9-4c36-87a4-106d4115fd5f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:54.630159 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-50e7dc68-0ed9-4c36-87a4-106d4115fd5f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:54.637570 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-50e7dc68-0ed9-4c36-87a4-106d4115fd5f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:54.638105 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-50e7dc68-0ed9-4c36-87a4-106d4115fd5f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:54.639121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-50e7dc68-0ed9-4c36-87a4-106d4115fd5f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:54.639622 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-50e7dc68-0ed9-4c36-87a4-106d4115fd5f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:54.793633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-50e7dc68-0ed9-4c36-87a4-106d4115fd5f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:54.803899 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-50e7dc68-0ed9-4c36-87a4-106d4115fd5f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.180487 May 23 15:31:54.804486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 118/238] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:54 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:54.851659 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-21024846-6c97-4a32-b041-3519fa10951c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "POST /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417998 May 23 15:31:54.852269 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 121/239] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 15:31:54 2022] POST /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/os-volume_attachments => generated 194 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:31:55.210477 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-61bb0569-bb0b-4fae-a7b1-521813c39df6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:55.211419 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-61bb0569-bb0b-4fae-a7b1-521813c39df6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:55.226634 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-61bb0569-bb0b-4fae-a7b1-521813c39df6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:55.227162 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-61bb0569-bb0b-4fae-a7b1-521813c39df6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:55.227858 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-61bb0569-bb0b-4fae-a7b1-521813c39df6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:55.228301 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-61bb0569-bb0b-4fae-a7b1-521813c39df6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:55.381342 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-61bb0569-bb0b-4fae-a7b1-521813c39df6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:55.404534 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-61bb0569-bb0b-4fae-a7b1-521813c39df6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:55.406089 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-61bb0569-bb0b-4fae-a7b1-521813c39df6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:55.407255 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-61bb0569-bb0b-4fae-a7b1-521813c39df6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.201384 May 23 15:31:55.407810 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 119/240] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:31:55 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:31:55.639502 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-78353fc2-e882-499a-b5cf-e33bbf3f71cf tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:55.640379 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-78353fc2-e882-499a-b5cf-e33bbf3f71cf tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:55.647563 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-78353fc2-e882-499a-b5cf-e33bbf3f71cf tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:55.648107 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-78353fc2-e882-499a-b5cf-e33bbf3f71cf tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:55.648967 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-78353fc2-e882-499a-b5cf-e33bbf3f71cf tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:55.649476 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-78353fc2-e882-499a-b5cf-e33bbf3f71cf tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:55.796537 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-78353fc2-e882-499a-b5cf-e33bbf3f71cf tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:55.806156 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-78353fc2-e882-499a-b5cf-e33bbf3f71cf tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.171822 May 23 15:31:55.806773 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 122/241] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:55 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:55.821642 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-486cf06b-6ec8-4507-8591-466abb6016a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:55.822502 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-486cf06b-6ec8-4507-8591-466abb6016a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:55.833161 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-486cf06b-6ec8-4507-8591-466abb6016a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:55.833614 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-486cf06b-6ec8-4507-8591-466abb6016a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:55.834400 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-486cf06b-6ec8-4507-8591-466abb6016a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:55.834849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-486cf06b-6ec8-4507-8591-466abb6016a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:55.973804 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-486cf06b-6ec8-4507-8591-466abb6016a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:55.983999 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-486cf06b-6ec8-4507-8591-466abb6016a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.166153 May 23 15:31:55.985122 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 120/242] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:55 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:56.426006 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-78360bda-fa7d-463e-ba46-7185698cd8f1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:56.426638 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-78360bda-fa7d-463e-ba46-7185698cd8f1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:56.433598 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-78360bda-fa7d-463e-ba46-7185698cd8f1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:56.433941 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-78360bda-fa7d-463e-ba46-7185698cd8f1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:56.434691 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-78360bda-fa7d-463e-ba46-7185698cd8f1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:56.435120 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-78360bda-fa7d-463e-ba46-7185698cd8f1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:56.580229 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-78360bda-fa7d-463e-ba46-7185698cd8f1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:56.589049 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-78360bda-fa7d-463e-ba46-7185698cd8f1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:56.590672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-78360bda-fa7d-463e-ba46-7185698cd8f1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:56.591948 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-78360bda-fa7d-463e-ba46-7185698cd8f1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.169847 May 23 15:31:56.593086 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 123/243] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:31:56 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:31:56.823287 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4329099f-d555-4e26-b853-d88f2e6ff580 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:56.824439 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4329099f-d555-4e26-b853-d88f2e6ff580 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:56.830487 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4329099f-d555-4e26-b853-d88f2e6ff580 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:56.830939 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4329099f-d555-4e26-b853-d88f2e6ff580 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:56.831705 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4329099f-d555-4e26-b853-d88f2e6ff580 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:56.832145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4329099f-d555-4e26-b853-d88f2e6ff580 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:56.965363 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4329099f-d555-4e26-b853-d88f2e6ff580 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:56.972690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4329099f-d555-4e26-b853-d88f2e6ff580 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.153319 May 23 15:31:56.973295 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 121/244] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:56 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:57.002204 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a2030099-512f-44c7-926b-d284b748b219 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:57.002813 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-a2030099-512f-44c7-926b-d284b748b219 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:57.010150 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a2030099-512f-44c7-926b-d284b748b219 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:57.015183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a2030099-512f-44c7-926b-d284b748b219 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:57.015183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a2030099-512f-44c7-926b-d284b748b219 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:57.015183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a2030099-512f-44c7-926b-d284b748b219 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:57.017757 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:57.152168 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a2030099-512f-44c7-926b-d284b748b219 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:57.160735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a2030099-512f-44c7-926b-d284b748b219 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.162074 May 23 15:31:57.161571 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 124/245] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:56 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:57.611128 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-111d55ec-e356-4676-ab25-83d41ec228d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:57.612029 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-111d55ec-e356-4676-ab25-83d41ec228d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:57.618250 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-111d55ec-e356-4676-ab25-83d41ec228d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:57.618702 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-111d55ec-e356-4676-ab25-83d41ec228d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:57.619473 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-111d55ec-e356-4676-ab25-83d41ec228d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:57.619913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-111d55ec-e356-4676-ab25-83d41ec228d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:57.635215 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:57.763404 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-111d55ec-e356-4676-ab25-83d41ec228d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:57.771494 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-111d55ec-e356-4676-ab25-83d41ec228d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:57.773025 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-111d55ec-e356-4676-ab25-83d41ec228d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:57.774164 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-111d55ec-e356-4676-ab25-83d41ec228d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.167033 May 23 15:31:57.774725 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 122/246] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:31:57 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:31:57.989741 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8e7d17f4-0140-4a20-8a0a-cdbe2305d4a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:57.990366 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8e7d17f4-0140-4a20-8a0a-cdbe2305d4a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:57.997425 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8e7d17f4-0140-4a20-8a0a-cdbe2305d4a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:57.997822 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8e7d17f4-0140-4a20-8a0a-cdbe2305d4a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:57.998598 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8e7d17f4-0140-4a20-8a0a-cdbe2305d4a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:57.999039 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8e7d17f4-0140-4a20-8a0a-cdbe2305d4a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:58.082714 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:58.147723 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8e7d17f4-0140-4a20-8a0a-cdbe2305d4a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:58.156444 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8e7d17f4-0140-4a20-8a0a-cdbe2305d4a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.170323 May 23 15:31:58.157264 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 125/247] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:57 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:58.178625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a8a991bd-ed3a-4b54-93bc-e6a7237ed4f5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:58.179262 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a8a991bd-ed3a-4b54-93bc-e6a7237ed4f5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:58.186195 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a8a991bd-ed3a-4b54-93bc-e6a7237ed4f5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:58.186642 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a8a991bd-ed3a-4b54-93bc-e6a7237ed4f5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:58.187410 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a8a991bd-ed3a-4b54-93bc-e6a7237ed4f5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:58.187838 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a8a991bd-ed3a-4b54-93bc-e6a7237ed4f5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:58.325770 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a8a991bd-ed3a-4b54-93bc-e6a7237ed4f5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:58.334202 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a8a991bd-ed3a-4b54-93bc-e6a7237ed4f5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.159546 May 23 15:31:58.335113 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 123/248] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:58 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:58.793074 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7b8a29a9-c4e9-47d3-9cfe-81d99b5b6d8f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:58.793694 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7b8a29a9-c4e9-47d3-9cfe-81d99b5b6d8f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:58.795506 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=12 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:58.800924 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7b8a29a9-c4e9-47d3-9cfe-81d99b5b6d8f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:58.801376 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7b8a29a9-c4e9-47d3-9cfe-81d99b5b6d8f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:58.802134 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7b8a29a9-c4e9-47d3-9cfe-81d99b5b6d8f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:58.802569 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7b8a29a9-c4e9-47d3-9cfe-81d99b5b6d8f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:58.936423 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-7b8a29a9-c4e9-47d3-9cfe-81d99b5b6d8f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:58.946168 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-7b8a29a9-c4e9-47d3-9cfe-81d99b5b6d8f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:58.947931 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-7b8a29a9-c4e9-47d3-9cfe-81d99b5b6d8f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:58.949560 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7b8a29a9-c4e9-47d3-9cfe-81d99b5b6d8f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.161097 May 23 15:31:58.950118 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 126/249] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:31:58 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:31:59.174218 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ed11b373-0562-40f4-98c4-ab7e65b66b35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:59.174839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ed11b373-0562-40f4-98c4-ab7e65b66b35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:59.181181 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ed11b373-0562-40f4-98c4-ab7e65b66b35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:59.181798 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ed11b373-0562-40f4-98c4-ab7e65b66b35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:59.182391 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ed11b373-0562-40f4-98c4-ab7e65b66b35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:59.183152 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ed11b373-0562-40f4-98c4-ab7e65b66b35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:59.322090 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ed11b373-0562-40f4-98c4-ab7e65b66b35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:59.329914 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ed11b373-0562-40f4-98c4-ab7e65b66b35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.159513 May 23 15:31:59.330412 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 124/250] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:59 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:59.350947 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-4c480521-c6be-4bd6-be27-ca3d74856f91 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:59.351595 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-4c480521-c6be-4bd6-be27-ca3d74856f91 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:59.358741 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4c480521-c6be-4bd6-be27-ca3d74856f91 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:59.359195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4c480521-c6be-4bd6-be27-ca3d74856f91 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:59.359966 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4c480521-c6be-4bd6-be27-ca3d74856f91 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:59.360406 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4c480521-c6be-4bd6-be27-ca3d74856f91 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:59.493317 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-4c480521-c6be-4bd6-be27-ca3d74856f91 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:31:59.500746 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-4c480521-c6be-4bd6-be27-ca3d74856f91 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.153569 May 23 15:31:59.501550 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 127/251] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:31:59 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:31:59.968829 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-897d093a-14d9-4d04-9b12-6746594a1ed4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:31:59.969481 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-897d093a-14d9-4d04-9b12-6746594a1ed4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:31:59.976588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-897d093a-14d9-4d04-9b12-6746594a1ed4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:59.977068 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-897d093a-14d9-4d04-9b12-6746594a1ed4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:31:59.977836 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-897d093a-14d9-4d04-9b12-6746594a1ed4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:31:59.979071 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-897d093a-14d9-4d04-9b12-6746594a1ed4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:00.161786 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-897d093a-14d9-4d04-9b12-6746594a1ed4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:00.170675 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-897d093a-14d9-4d04-9b12-6746594a1ed4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:00.172286 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-897d093a-14d9-4d04-9b12-6746594a1ed4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:00.173498 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-897d093a-14d9-4d04-9b12-6746594a1ed4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.209290 May 23 15:32:00.174057 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 125/252] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:31:59 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:00.356585 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8507bd0d-b917-4100-a1ce-9d0656b10ede tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:00.357229 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8507bd0d-b917-4100-a1ce-9d0656b10ede tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:00.368677 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8507bd0d-b917-4100-a1ce-9d0656b10ede tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:00.369192 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8507bd0d-b917-4100-a1ce-9d0656b10ede tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:00.369989 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8507bd0d-b917-4100-a1ce-9d0656b10ede tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:00.370442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8507bd0d-b917-4100-a1ce-9d0656b10ede tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:00.520402 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5d56a5b4-f33b-4648-8195-34184651d480 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:00.522001 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-5d56a5b4-f33b-4648-8195-34184651d480 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:00.538958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5d56a5b4-f33b-4648-8195-34184651d480 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:00.539767 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5d56a5b4-f33b-4648-8195-34184651d480 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:00.541115 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5d56a5b4-f33b-4648-8195-34184651d480 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:00.541815 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5d56a5b4-f33b-4648-8195-34184651d480 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:00.588078 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8507bd0d-b917-4100-a1ce-9d0656b10ede tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:00.600643 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8507bd0d-b917-4100-a1ce-9d0656b10ede tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.257913 May 23 15:32:00.601398 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 128/253] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:00 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:00.729035 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-5d56a5b4-f33b-4648-8195-34184651d480 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:00.739135 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5d56a5b4-f33b-4648-8195-34184651d480 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.223817 May 23 15:32:00.741237 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 126/254] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:00 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:01.192055 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-2c1dc9fe-a142-4e77-89d8-3daae947eb95 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:01.193199 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-2c1dc9fe-a142-4e77-89d8-3daae947eb95 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:01.201336 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2c1dc9fe-a142-4e77-89d8-3daae947eb95 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:01.202034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2c1dc9fe-a142-4e77-89d8-3daae947eb95 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:01.203028 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2c1dc9fe-a142-4e77-89d8-3daae947eb95 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:01.203678 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2c1dc9fe-a142-4e77-89d8-3daae947eb95 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:01.420250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-2c1dc9fe-a142-4e77-89d8-3daae947eb95 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:01.431118 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-2c1dc9fe-a142-4e77-89d8-3daae947eb95 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:01.438801 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-2c1dc9fe-a142-4e77-89d8-3daae947eb95 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:01.440097 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-2c1dc9fe-a142-4e77-89d8-3daae947eb95 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.251951 May 23 15:32:01.441167 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 129/255] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:01 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:01.618879 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4ffd9379-05d1-40f5-b0d1-6af4a8eeb34d tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:01.619501 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4ffd9379-05d1-40f5-b0d1-6af4a8eeb34d tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:01.626875 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4ffd9379-05d1-40f5-b0d1-6af4a8eeb34d tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:01.627362 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4ffd9379-05d1-40f5-b0d1-6af4a8eeb34d tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:01.628179 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4ffd9379-05d1-40f5-b0d1-6af4a8eeb34d tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:01.628622 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4ffd9379-05d1-40f5-b0d1-6af4a8eeb34d tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:01.689584 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b945a604-11c7-4f19-9137-a967e770c7e6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Action: 'create', calling method: .version_select at 0x7f0d7a5a80d0>, body: {"keypair": {"name": "tempest-keypair-1923131915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpkRmfDIKitB3UaaYtx2s9IGO1DTQhEcO1T5In24DEUZUC30iHsbafo+v595vMTGA+riKRMg1UsGherUrxAiFhBgUMvO/7T158kmc2L3DqHQd5eGZxKvmgkC+FJqqrfMQ=="}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:32:01.706771 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-b945a604-11c7-4f19-9137-a967e770c7e6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Getting quotas for project f2020e2bf35744af9161d7cf3e8bd345. Resources: {'key_pairs'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:32:01.711202 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-b945a604-11c7-4f19-9137-a967e770c7e6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Getting quotas for user 06431315dc8040cbbafbe83a3ed8e0e4 and project f2020e2bf35744af9161d7cf3e8bd345. Resources: {'key_pairs'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:32:01.784936 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b945a604-11c7-4f19-9137-a967e770c7e6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099631 May 23 15:32:01.785569 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 130/256] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 15:32:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:32:01.797434 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-9fc63275-f6b7-4181-8ed6-10fac3cd1322 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:01.798125 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-9fc63275-f6b7-4181-8ed6-10fac3cd1322 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:01.799049 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4ffd9379-05d1-40f5-b0d1-6af4a8eeb34d tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:01.810502 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4ffd9379-05d1-40f5-b0d1-6af4a8eeb34d tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.195276 May 23 15:32:01.818213 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 127/257] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:01 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:01.830575 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9fc63275-f6b7-4181-8ed6-10fac3cd1322 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:01.831293 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9fc63275-f6b7-4181-8ed6-10fac3cd1322 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:01.838460 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9fc63275-f6b7-4181-8ed6-10fac3cd1322 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:01.842810 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9fc63275-f6b7-4181-8ed6-10fac3cd1322 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:02.129851 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9fc63275-f6b7-4181-8ed6-10fac3cd1322 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:02.138370 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-9fc63275-f6b7-4181-8ed6-10fac3cd1322 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.345990 May 23 15:32:02.139529 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 131/258] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:01 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:02.460342 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4b6773a0-2a1d-405e-8e5c-d6a47ef177e7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:02.461503 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4b6773a0-2a1d-405e-8e5c-d6a47ef177e7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:02.469886 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4b6773a0-2a1d-405e-8e5c-d6a47ef177e7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:02.470968 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4b6773a0-2a1d-405e-8e5c-d6a47ef177e7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:02.472466 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4b6773a0-2a1d-405e-8e5c-d6a47ef177e7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:02.473280 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4b6773a0-2a1d-405e-8e5c-d6a47ef177e7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:02.719867 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4b6773a0-2a1d-405e-8e5c-d6a47ef177e7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:02.728441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4b6773a0-2a1d-405e-8e5c-d6a47ef177e7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:02.730066 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4b6773a0-2a1d-405e-8e5c-d6a47ef177e7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:02.731664 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4b6773a0-2a1d-405e-8e5c-d6a47ef177e7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.275991 May 23 15:32:02.748063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 128/259] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:02 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:02.829300 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-41b38314-9ac2-420e-a0d2-2bf1af2f987f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:02.830865 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-41b38314-9ac2-420e-a0d2-2bf1af2f987f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:02.855920 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-41b38314-9ac2-420e-a0d2-2bf1af2f987f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:02.856773 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-41b38314-9ac2-420e-a0d2-2bf1af2f987f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:02.858038 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-41b38314-9ac2-420e-a0d2-2bf1af2f987f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:02.858484 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-41b38314-9ac2-420e-a0d2-2bf1af2f987f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:03.157682 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f2e56bd0-08cb-423e-9d01-719dc5626b3f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:03.158296 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f2e56bd0-08cb-423e-9d01-719dc5626b3f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:03.175331 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f2e56bd0-08cb-423e-9d01-719dc5626b3f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:03.176164 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f2e56bd0-08cb-423e-9d01-719dc5626b3f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:03.177166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f2e56bd0-08cb-423e-9d01-719dc5626b3f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:03.177877 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f2e56bd0-08cb-423e-9d01-719dc5626b3f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:03.218429 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-41b38314-9ac2-420e-a0d2-2bf1af2f987f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:03.235522 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-41b38314-9ac2-420e-a0d2-2bf1af2f987f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.411727 May 23 15:32:03.245745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 132/260] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:02 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:03.739195 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-f2e56bd0-08cb-423e-9d01-719dc5626b3f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:03.751843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f2e56bd0-08cb-423e-9d01-719dc5626b3f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.599973 May 23 15:32:03.752041 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-236d0f40-d6ba-4182-8082-2ff8eac9a120 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:03.752635 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-236d0f40-d6ba-4182-8082-2ff8eac9a120 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:03.760649 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-236d0f40-d6ba-4182-8082-2ff8eac9a120 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:03.765795 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 129/261] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:03 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:03.766244 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-236d0f40-d6ba-4182-8082-2ff8eac9a120 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:03.767315 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-236d0f40-d6ba-4182-8082-2ff8eac9a120 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:03.767906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-236d0f40-d6ba-4182-8082-2ff8eac9a120 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:04.126607 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-236d0f40-d6ba-4182-8082-2ff8eac9a120 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:04.140963 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-236d0f40-d6ba-4182-8082-2ff8eac9a120 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:04.153370 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-236d0f40-d6ba-4182-8082-2ff8eac9a120 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:04.169062 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-236d0f40-d6ba-4182-8082-2ff8eac9a120 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.421481 May 23 15:32:04.169670 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 133/262] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:03 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:04.253963 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d6575c20-608a-4883-9b14-a1194af87594 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:04.254898 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d6575c20-608a-4883-9b14-a1194af87594 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:04.261913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d6575c20-608a-4883-9b14-a1194af87594 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:04.263190 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d6575c20-608a-4883-9b14-a1194af87594 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:04.269572 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d6575c20-608a-4883-9b14-a1194af87594 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:04.272817 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d6575c20-608a-4883-9b14-a1194af87594 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:04.377412 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8ee465cc-442e-4fa2-93ad-51b344ab9d8e tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-970577103", "imageRef": "807d39e3-2293-48ca-b2cd-675f7c931014", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9306d40-6dd5-4f4d-bb55-9077bd7b986d"}], "security_groups": [{"name": "tempest-securitygroup--852344953"}], "key_name": "tempest-keypair-1923131915", "user_data": "}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:32:04.386860 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:04.472900 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d6575c20-608a-4883-9b14-a1194af87594 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:04.481510 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d6575c20-608a-4883-9b14-a1194af87594 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.231295 May 23 15:32:04.482395 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 130/263] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:04 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:04.782769 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-20e3731f-c9f7-4c2c-b9f1-7040c19821de tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:04.783644 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-20e3731f-c9f7-4c2c-b9f1-7040c19821de tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:04.785302 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.network.neutron [None req-8ee465cc-442e-4fa2-93ad-51b344ab9d8e tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] validate_networks() for [('c9306d40-6dd5-4f4d-bb55-9077bd7b986d', None, None, None, None, None)] {{(pid=117973) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:32:04.790796 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-20e3731f-c9f7-4c2c-b9f1-7040c19821de tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:04.791444 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-20e3731f-c9f7-4c2c-b9f1-7040c19821de tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:04.792487 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-20e3731f-c9f7-4c2c-b9f1-7040c19821de tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:04.792978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-20e3731f-c9f7-4c2c-b9f1-7040c19821de tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:04.982140 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-20e3731f-c9f7-4c2c-b9f1-7040c19821de tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:04.997217 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-20e3731f-c9f7-4c2c-b9f1-7040c19821de tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.216174 May 23 15:32:04.998304 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 131/264] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:04 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:05.188179 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3460135d-e17b-48ae-9153-0315a2f5205a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:05.188792 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3460135d-e17b-48ae-9153-0315a2f5205a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:05.196196 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3460135d-e17b-48ae-9153-0315a2f5205a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:05.196649 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3460135d-e17b-48ae-9153-0315a2f5205a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:05.197461 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3460135d-e17b-48ae-9153-0315a2f5205a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:05.197897 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3460135d-e17b-48ae-9153-0315a2f5205a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:05.397353 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-8ee465cc-442e-4fa2-93ad-51b344ab9d8e tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Flavor limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:32:05.398392 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-8ee465cc-442e-4fa2-93ad-51b344ab9d8e tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Image limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:32:05.399142 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-8ee465cc-442e-4fa2-93ad-51b344ab9d8e tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Flavor pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:32:05.399710 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-8ee465cc-442e-4fa2-93ad-51b344ab9d8e tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Image pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:32:05.400356 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-8ee465cc-442e-4fa2-93ad-51b344ab9d8e tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:32:05.420181 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8ee465cc-442e-4fa2-93ad-51b344ab9d8e tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:05.420895 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8ee465cc-442e-4fa2-93ad-51b344ab9d8e tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:05.422081 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8ee465cc-442e-4fa2-93ad-51b344ab9d8e tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:05.425508 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8ee465cc-442e-4fa2-93ad-51b344ab9d8e tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:05.484957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-8ee465cc-442e-4fa2-93ad-51b344ab9d8e tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Getting quotas for project f2020e2bf35744af9161d7cf3e8bd345. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:32:05.491070 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-8ee465cc-442e-4fa2-93ad-51b344ab9d8e tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Getting quotas for user 06431315dc8040cbbafbe83a3ed8e0e4 and project f2020e2bf35744af9161d7cf3e8bd345. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:32:05.507193 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8ee465cc-442e-4fa2-93ad-51b344ab9d8e tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Going to run 1 instances... {{(pid=117973) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:32:05.509776 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8ee465cc-442e-4fa2-93ad-51b344ab9d8e tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='807d39e3-2293-48ca-b2cd-675f7c931014',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:32:05.535725 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3460135d-e17b-48ae-9153-0315a2f5205a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:05.545594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3460135d-e17b-48ae-9153-0315a2f5205a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:05.548626 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3460135d-e17b-48ae-9153-0315a2f5205a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:05.562393 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3460135d-e17b-48ae-9153-0315a2f5205a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.377931 May 23 15:32:05.563238 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 132/265] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:05 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:05.577702 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a4de44a2-d939-46bf-b683-1084f2e189ec tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:05.578589 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a4de44a2-d939-46bf-b683-1084f2e189ec tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:05.593320 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a4de44a2-d939-46bf-b683-1084f2e189ec tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:05.594066 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8ee465cc-442e-4fa2-93ad-51b344ab9d8e tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.221570 May 23 15:32:05.595192 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 134/266] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:32:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:32:05.600270 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a4de44a2-d939-46bf-b683-1084f2e189ec tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:05.601142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a4de44a2-d939-46bf-b683-1084f2e189ec tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:05.601588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a4de44a2-d939-46bf-b683-1084f2e189ec tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:05.636360 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-298b6636-7009-4fe9-b59a-5d70d7a3810c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:05.638150 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-298b6636-7009-4fe9-b59a-5d70d7a3810c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:05.703439 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-298b6636-7009-4fe9-b59a-5d70d7a3810c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:05.711501 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-298b6636-7009-4fe9-b59a-5d70d7a3810c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1241 microversion: 2.1 time: 0.085815 May 23 15:32:05.713480 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 135/267] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:05 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:05.876411 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a4de44a2-d939-46bf-b683-1084f2e189ec tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:05.886117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a4de44a2-d939-46bf-b683-1084f2e189ec tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.319474 May 23 15:32:05.886707 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 133/268] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:05 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:06.017790 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-6a921169-668c-4988-b82b-63155eb22f1c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:06.018840 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-6a921169-668c-4988-b82b-63155eb22f1c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:06.052543 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6a921169-668c-4988-b82b-63155eb22f1c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:06.054606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6a921169-668c-4988-b82b-63155eb22f1c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:06.057843 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6a921169-668c-4988-b82b-63155eb22f1c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:06.060745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6a921169-668c-4988-b82b-63155eb22f1c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:06.388322 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-6a921169-668c-4988-b82b-63155eb22f1c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:06.398411 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-6a921169-668c-4988-b82b-63155eb22f1c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.386584 May 23 15:32:06.399846 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 136/269] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:06 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:06.581753 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-73ee919c-a979-4111-917f-5b2e598c9851 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:06.582287 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-73ee919c-a979-4111-917f-5b2e598c9851 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:06.593080 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-73ee919c-a979-4111-917f-5b2e598c9851 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:06.593851 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-73ee919c-a979-4111-917f-5b2e598c9851 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:06.594867 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-73ee919c-a979-4111-917f-5b2e598c9851 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:06.595388 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-73ee919c-a979-4111-917f-5b2e598c9851 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:06.737733 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7250eaae-ce3d-4b5f-921e-cb9ae6329108 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:06.738636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7250eaae-ce3d-4b5f-921e-cb9ae6329108 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:06.745810 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7250eaae-ce3d-4b5f-921e-cb9ae6329108 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:06.746566 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7250eaae-ce3d-4b5f-921e-cb9ae6329108 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:06.747685 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7250eaae-ce3d-4b5f-921e-cb9ae6329108 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:06.748286 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7250eaae-ce3d-4b5f-921e-cb9ae6329108 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:06.788397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-73ee919c-a979-4111-917f-5b2e598c9851 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:06.797153 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-73ee919c-a979-4111-917f-5b2e598c9851 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:06.798650 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-73ee919c-a979-4111-917f-5b2e598c9851 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:06.799809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-73ee919c-a979-4111-917f-5b2e598c9851 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.222073 May 23 15:32:06.800368 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 134/270] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:06 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:06.838275 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-7250eaae-ce3d-4b5f-921e-cb9ae6329108 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:06.847776 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7250eaae-ce3d-4b5f-921e-cb9ae6329108 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1245 microversion: 2.1 time: 0.116108 May 23 15:32:06.848689 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 137/271] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:06 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1245 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:06.904795 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-299d0f97-bab0-44a5-9eba-97eb63b0dff7 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:06.912580 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-299d0f97-bab0-44a5-9eba-97eb63b0dff7 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:06.925191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-299d0f97-bab0-44a5-9eba-97eb63b0dff7 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:06.925655 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-299d0f97-bab0-44a5-9eba-97eb63b0dff7 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:06.926429 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-299d0f97-bab0-44a5-9eba-97eb63b0dff7 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:06.927373 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-299d0f97-bab0-44a5-9eba-97eb63b0dff7 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:07.114035 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-299d0f97-bab0-44a5-9eba-97eb63b0dff7 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:07.127479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-299d0f97-bab0-44a5-9eba-97eb63b0dff7 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.227448 May 23 15:32:07.128233 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 135/272] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:06 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:07.417731 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-78fad2b8-1a93-4a87-bf9d-51554f7d3002 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:07.419272 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-78fad2b8-1a93-4a87-bf9d-51554f7d3002 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:07.427166 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-78fad2b8-1a93-4a87-bf9d-51554f7d3002 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:07.428095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-78fad2b8-1a93-4a87-bf9d-51554f7d3002 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:07.429018 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-78fad2b8-1a93-4a87-bf9d-51554f7d3002 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:07.429678 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-78fad2b8-1a93-4a87-bf9d-51554f7d3002 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:07.620528 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-78fad2b8-1a93-4a87-bf9d-51554f7d3002 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:07.630687 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-78fad2b8-1a93-4a87-bf9d-51554f7d3002 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.217347 May 23 15:32:07.631239 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 138/273] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:07 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:07.818728 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-41a28659-de3d-4b66-b901-c18ee9aa69f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:07.819744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-41a28659-de3d-4b66-b901-c18ee9aa69f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:07.826927 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-41a28659-de3d-4b66-b901-c18ee9aa69f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:07.828344 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-41a28659-de3d-4b66-b901-c18ee9aa69f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:07.829399 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-41a28659-de3d-4b66-b901-c18ee9aa69f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:07.830468 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-41a28659-de3d-4b66-b901-c18ee9aa69f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:07.867332 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-195d5fd2-c2fa-477e-836b-c94ba9093300 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:07.888030 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-195d5fd2-c2fa-477e-836b-c94ba9093300 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:07.905886 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-195d5fd2-c2fa-477e-836b-c94ba9093300 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:07.906399 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-195d5fd2-c2fa-477e-836b-c94ba9093300 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:07.907134 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-195d5fd2-c2fa-477e-836b-c94ba9093300 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:07.907569 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-195d5fd2-c2fa-477e-836b-c94ba9093300 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:07.993185 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-195d5fd2-c2fa-477e-836b-c94ba9093300 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:08.008955 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-195d5fd2-c2fa-477e-836b-c94ba9093300 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1245 microversion: 2.1 time: 0.146450 May 23 15:32:08.010447 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 139/274] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:07 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1245 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:08.096815 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-41a28659-de3d-4b66-b901-c18ee9aa69f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:08.118855 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-41a28659-de3d-4b66-b901-c18ee9aa69f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:08.120964 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-41a28659-de3d-4b66-b901-c18ee9aa69f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:08.122172 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-41a28659-de3d-4b66-b901-c18ee9aa69f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.307407 May 23 15:32:08.122768 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 136/275] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:07 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:08.146658 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f09fd0e2-853d-452f-8385-1fe1ea0113e1 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:08.148272 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f09fd0e2-853d-452f-8385-1fe1ea0113e1 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:08.169043 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f09fd0e2-853d-452f-8385-1fe1ea0113e1 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:08.170180 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f09fd0e2-853d-452f-8385-1fe1ea0113e1 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:08.171620 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f09fd0e2-853d-452f-8385-1fe1ea0113e1 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:08.172292 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f09fd0e2-853d-452f-8385-1fe1ea0113e1 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:08.423465 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f09fd0e2-853d-452f-8385-1fe1ea0113e1 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:08.440315 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f09fd0e2-853d-452f-8385-1fe1ea0113e1 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.292895 May 23 15:32:08.441837 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 140/276] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:08 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:08.649322 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b42c948a-bd8b-4067-a636-16b7b6a01752 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:08.649860 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b42c948a-bd8b-4067-a636-16b7b6a01752 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:08.656150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b42c948a-bd8b-4067-a636-16b7b6a01752 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:08.656609 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b42c948a-bd8b-4067-a636-16b7b6a01752 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:08.657421 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b42c948a-bd8b-4067-a636-16b7b6a01752 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:08.657867 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b42c948a-bd8b-4067-a636-16b7b6a01752 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:08.791647 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b42c948a-bd8b-4067-a636-16b7b6a01752 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:08.799139 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b42c948a-bd8b-4067-a636-16b7b6a01752 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.154228 May 23 15:32:08.799706 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 137/277] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:08 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:09.028676 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1cb49217-10ef-47d0-9190-6ed1130db114 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:09.029335 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-1cb49217-10ef-47d0-9190-6ed1130db114 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:09.035578 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1cb49217-10ef-47d0-9190-6ed1130db114 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:09.036033 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1cb49217-10ef-47d0-9190-6ed1130db114 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:09.036803 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1cb49217-10ef-47d0-9190-6ed1130db114 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:09.037274 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1cb49217-10ef-47d0-9190-6ed1130db114 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:09.104052 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-1cb49217-10ef-47d0-9190-6ed1130db114 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:09.112051 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1cb49217-10ef-47d0-9190-6ed1130db114 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1245 microversion: 2.1 time: 0.087507 May 23 15:32:09.112619 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 141/278] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:09 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:09.139902 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4a36cae1-e5cd-4a85-8f6d-cb7b1560acc7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:09.140519 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4a36cae1-e5cd-4a85-8f6d-cb7b1560acc7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:09.146987 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4a36cae1-e5cd-4a85-8f6d-cb7b1560acc7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:09.147442 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4a36cae1-e5cd-4a85-8f6d-cb7b1560acc7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:09.148211 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4a36cae1-e5cd-4a85-8f6d-cb7b1560acc7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:09.148658 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4a36cae1-e5cd-4a85-8f6d-cb7b1560acc7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:09.284655 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4a36cae1-e5cd-4a85-8f6d-cb7b1560acc7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:09.294086 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4a36cae1-e5cd-4a85-8f6d-cb7b1560acc7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:09.295564 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4a36cae1-e5cd-4a85-8f6d-cb7b1560acc7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:09.296747 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4a36cae1-e5cd-4a85-8f6d-cb7b1560acc7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.161110 May 23 15:32:09.297329 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 138/279] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:09 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:09.459112 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-6139bc0a-4b32-4198-be31-78b93f6a71e5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:09.459777 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-6139bc0a-4b32-4198-be31-78b93f6a71e5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:09.466972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6139bc0a-4b32-4198-be31-78b93f6a71e5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:09.467483 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6139bc0a-4b32-4198-be31-78b93f6a71e5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:09.468323 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6139bc0a-4b32-4198-be31-78b93f6a71e5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:09.468770 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6139bc0a-4b32-4198-be31-78b93f6a71e5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:09.603678 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-6139bc0a-4b32-4198-be31-78b93f6a71e5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:09.611701 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-6139bc0a-4b32-4198-be31-78b93f6a71e5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.156962 May 23 15:32:09.617832 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 142/280] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:09 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:09.816690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5e66d12a-7fc1-490d-916b-3da207829237 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:09.817303 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-5e66d12a-7fc1-490d-916b-3da207829237 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:09.823844 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5e66d12a-7fc1-490d-916b-3da207829237 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:09.824425 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5e66d12a-7fc1-490d-916b-3da207829237 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:09.825238 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5e66d12a-7fc1-490d-916b-3da207829237 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:09.825682 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5e66d12a-7fc1-490d-916b-3da207829237 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:09.829541 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=100 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:09.957734 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-5e66d12a-7fc1-490d-916b-3da207829237 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:09.965872 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5e66d12a-7fc1-490d-916b-3da207829237 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.153218 May 23 15:32:09.966453 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 139/281] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:09 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:10.129533 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-440baad6-6867-4cbb-9099-a1996fb38fea tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:10.130147 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-440baad6-6867-4cbb-9099-a1996fb38fea tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:10.136157 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-440baad6-6867-4cbb-9099-a1996fb38fea tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:10.136608 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-440baad6-6867-4cbb-9099-a1996fb38fea tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:10.137648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-440baad6-6867-4cbb-9099-a1996fb38fea tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:10.138101 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-440baad6-6867-4cbb-9099-a1996fb38fea tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:10.153128 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=100 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:10.197064 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-440baad6-6867-4cbb-9099-a1996fb38fea tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:10.204521 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-440baad6-6867-4cbb-9099-a1996fb38fea tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1245 microversion: 2.1 time: 0.078929 May 23 15:32:10.205123 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 143/282] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:10 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1245 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:10.315079 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-0bb913d3-72da-40ed-987c-5eed3a46e67b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:10.315708 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-0bb913d3-72da-40ed-987c-5eed3a46e67b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:10.322198 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0bb913d3-72da-40ed-987c-5eed3a46e67b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:10.322641 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0bb913d3-72da-40ed-987c-5eed3a46e67b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:10.324157 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0bb913d3-72da-40ed-987c-5eed3a46e67b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:10.324803 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0bb913d3-72da-40ed-987c-5eed3a46e67b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:10.452810 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0bb913d3-72da-40ed-987c-5eed3a46e67b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:10.460769 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0bb913d3-72da-40ed-987c-5eed3a46e67b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:10.462317 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0bb913d3-72da-40ed-987c-5eed3a46e67b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:10.463486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-0bb913d3-72da-40ed-987c-5eed3a46e67b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.152294 May 23 15:32:10.464276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 140/283] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:10 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:10.628591 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-15954dff-f693-493e-b2a7-6472a0a2fcf1 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:10.629170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-15954dff-f693-493e-b2a7-6472a0a2fcf1 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:10.635660 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-15954dff-f693-493e-b2a7-6472a0a2fcf1 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:10.636858 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-15954dff-f693-493e-b2a7-6472a0a2fcf1 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:10.638185 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-15954dff-f693-493e-b2a7-6472a0a2fcf1 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:10.638765 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-15954dff-f693-493e-b2a7-6472a0a2fcf1 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:10.771246 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-15954dff-f693-493e-b2a7-6472a0a2fcf1 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:10.783885 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-15954dff-f693-493e-b2a7-6472a0a2fcf1 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.159101 May 23 15:32:10.784460 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 144/284] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:10 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:10.983645 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ea1d0b45-a25c-4722-9c19-ffe23dd14897 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:10.984267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ea1d0b45-a25c-4722-9c19-ffe23dd14897 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:10.990317 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ea1d0b45-a25c-4722-9c19-ffe23dd14897 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:10.990767 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ea1d0b45-a25c-4722-9c19-ffe23dd14897 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:10.991538 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ea1d0b45-a25c-4722-9c19-ffe23dd14897 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:10.991978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ea1d0b45-a25c-4722-9c19-ffe23dd14897 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:11.117755 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ea1d0b45-a25c-4722-9c19-ffe23dd14897 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:11.125975 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ea1d0b45-a25c-4722-9c19-ffe23dd14897 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.146997 May 23 15:32:11.126542 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 141/285] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:10 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:11.221263 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-9ccac229-a1fe-4174-9eb1-c5d6406531b1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:11.222445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-9ccac229-a1fe-4174-9eb1-c5d6406531b1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:11.228474 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9ccac229-a1fe-4174-9eb1-c5d6406531b1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:11.229342 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9ccac229-a1fe-4174-9eb1-c5d6406531b1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:11.230871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9ccac229-a1fe-4174-9eb1-c5d6406531b1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:11.231303 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9ccac229-a1fe-4174-9eb1-c5d6406531b1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:11.300830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9ccac229-a1fe-4174-9eb1-c5d6406531b1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:11.309289 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-9ccac229-a1fe-4174-9eb1-c5d6406531b1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1245 microversion: 2.1 time: 0.092031 May 23 15:32:11.309868 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 145/286] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:11 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:11.486870 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-1b677b48-d781-4645-ae30-66c11fcb9b20 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:11.487631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-1b677b48-d781-4645-ae30-66c11fcb9b20 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:11.489903 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=76 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:11.495482 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1b677b48-d781-4645-ae30-66c11fcb9b20 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:11.495934 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1b677b48-d781-4645-ae30-66c11fcb9b20 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:11.496685 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1b677b48-d781-4645-ae30-66c11fcb9b20 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:11.497141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1b677b48-d781-4645-ae30-66c11fcb9b20 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:11.643694 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1b677b48-d781-4645-ae30-66c11fcb9b20 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:11.652646 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1b677b48-d781-4645-ae30-66c11fcb9b20 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:11.654201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1b677b48-d781-4645-ae30-66c11fcb9b20 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:11.655372 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-1b677b48-d781-4645-ae30-66c11fcb9b20 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.172444 May 23 15:32:11.655932 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 142/287] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:11 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:11.800269 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-58a9126e-a090-486d-8588-f7da457687cb tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:11.801079 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-58a9126e-a090-486d-8588-f7da457687cb tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:11.807900 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58a9126e-a090-486d-8588-f7da457687cb tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:11.808357 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58a9126e-a090-486d-8588-f7da457687cb tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:11.809150 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58a9126e-a090-486d-8588-f7da457687cb tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:11.809646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58a9126e-a090-486d-8588-f7da457687cb tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:11.950429 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-58a9126e-a090-486d-8588-f7da457687cb tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:11.960659 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-58a9126e-a090-486d-8588-f7da457687cb tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.164180 May 23 15:32:11.971596 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 146/288] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:11 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:12.143031 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-de79f7d7-9c82-499b-86ca-862db9fd0839 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:12.143651 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-de79f7d7-9c82-499b-86ca-862db9fd0839 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:12.150567 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-de79f7d7-9c82-499b-86ca-862db9fd0839 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:12.151023 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-de79f7d7-9c82-499b-86ca-862db9fd0839 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:12.151796 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-de79f7d7-9c82-499b-86ca-862db9fd0839 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:12.152239 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-de79f7d7-9c82-499b-86ca-862db9fd0839 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:12.299604 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-de79f7d7-9c82-499b-86ca-862db9fd0839 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:12.307559 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-de79f7d7-9c82-499b-86ca-862db9fd0839 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.168806 May 23 15:32:12.308143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 143/289] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:12 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:12.326801 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b3201018-90a9-4c64-a760-226a498737e9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:12.327505 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b3201018-90a9-4c64-a760-226a498737e9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:12.333501 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b3201018-90a9-4c64-a760-226a498737e9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:12.333962 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b3201018-90a9-4c64-a760-226a498737e9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:12.334886 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b3201018-90a9-4c64-a760-226a498737e9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:12.335333 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b3201018-90a9-4c64-a760-226a498737e9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:12.400945 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b3201018-90a9-4c64-a760-226a498737e9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:12.408840 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b3201018-90a9-4c64-a760-226a498737e9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1301 microversion: 2.1 time: 0.087301 May 23 15:32:12.409439 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 147/290] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:12 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1301 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:12.675486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-09422e18-3539-43ee-8a9e-3fa17470d7ba tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:12.676653 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-09422e18-3539-43ee-8a9e-3fa17470d7ba tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:12.685486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-09422e18-3539-43ee-8a9e-3fa17470d7ba tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:12.686592 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-09422e18-3539-43ee-8a9e-3fa17470d7ba tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:12.688332 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-09422e18-3539-43ee-8a9e-3fa17470d7ba tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:12.688966 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-09422e18-3539-43ee-8a9e-3fa17470d7ba tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:12.837097 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-09422e18-3539-43ee-8a9e-3fa17470d7ba tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:12.847957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-09422e18-3539-43ee-8a9e-3fa17470d7ba tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:12.849511 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-09422e18-3539-43ee-8a9e-3fa17470d7ba tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:12.850727 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-09422e18-3539-43ee-8a9e-3fa17470d7ba tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1745 microversion: 2.20 time: 0.179179 May 23 15:32:12.851372 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 144/291] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:12 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:12.979100 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-782828bd-0557-4cc1-914c-dc08d77e713b tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:12.979753 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-782828bd-0557-4cc1-914c-dc08d77e713b tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:12.986772 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-782828bd-0557-4cc1-914c-dc08d77e713b tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:12.987327 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-782828bd-0557-4cc1-914c-dc08d77e713b tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:12.988180 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-782828bd-0557-4cc1-914c-dc08d77e713b tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:12.988628 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-782828bd-0557-4cc1-914c-dc08d77e713b tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:13.174214 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-782828bd-0557-4cc1-914c-dc08d77e713b tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:13.185701 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-782828bd-0557-4cc1-914c-dc08d77e713b tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.210186 May 23 15:32:13.186329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 148/292] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:12 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:13.325160 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-1119d906-e8fa-47ed-9d78-47bee711ad34 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:13.325788 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-1119d906-e8fa-47ed-9d78-47bee711ad34 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:13.332922 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1119d906-e8fa-47ed-9d78-47bee711ad34 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:13.333438 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1119d906-e8fa-47ed-9d78-47bee711ad34 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:13.334226 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1119d906-e8fa-47ed-9d78-47bee711ad34 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:13.334795 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1119d906-e8fa-47ed-9d78-47bee711ad34 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:13.426297 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-af1aa4e4-c4b1-4525-bd6d-299493201875 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:13.428047 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-af1aa4e4-c4b1-4525-bd6d-299493201875 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:13.436063 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-af1aa4e4-c4b1-4525-bd6d-299493201875 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:13.436816 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-af1aa4e4-c4b1-4525-bd6d-299493201875 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:13.437937 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-af1aa4e4-c4b1-4525-bd6d-299493201875 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:13.438739 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-af1aa4e4-c4b1-4525-bd6d-299493201875 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:13.486133 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1119d906-e8fa-47ed-9d78-47bee711ad34 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:13.493732 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-1119d906-e8fa-47ed-9d78-47bee711ad34 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.172883 May 23 15:32:13.494304 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 145/293] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:13 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:13.503784 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-af1aa4e4-c4b1-4525-bd6d-299493201875 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:13.511449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-af1aa4e4-c4b1-4525-bd6d-299493201875 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1311 microversion: 2.1 time: 0.089181 May 23 15:32:13.512078 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 149/294] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:13 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1311 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:13.869507 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3015a0cc-00d6-46b7-b4ec-5f71398b42a1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:13.870602 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3015a0cc-00d6-46b7-b4ec-5f71398b42a1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:13.877122 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3015a0cc-00d6-46b7-b4ec-5f71398b42a1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:13.877579 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3015a0cc-00d6-46b7-b4ec-5f71398b42a1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:13.878340 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3015a0cc-00d6-46b7-b4ec-5f71398b42a1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:13.878777 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3015a0cc-00d6-46b7-b4ec-5f71398b42a1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:14.014187 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3015a0cc-00d6-46b7-b4ec-5f71398b42a1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:14.022136 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3015a0cc-00d6-46b7-b4ec-5f71398b42a1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:14.023680 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3015a0cc-00d6-46b7-b4ec-5f71398b42a1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:14.024848 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3015a0cc-00d6-46b7-b4ec-5f71398b42a1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1745 microversion: 2.20 time: 0.159340 May 23 15:32:14.025428 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 146/295] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:13 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:14.203451 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-458397b8-e91f-4497-8298-044f0b1d2891 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:14.203973 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-458397b8-e91f-4497-8298-044f0b1d2891 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:14.210427 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-458397b8-e91f-4497-8298-044f0b1d2891 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:14.210882 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-458397b8-e91f-4497-8298-044f0b1d2891 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:14.211651 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-458397b8-e91f-4497-8298-044f0b1d2891 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:14.212089 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-458397b8-e91f-4497-8298-044f0b1d2891 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:14.341386 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-458397b8-e91f-4497-8298-044f0b1d2891 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:14.349194 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-458397b8-e91f-4497-8298-044f0b1d2891 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.150017 May 23 15:32:14.350017 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 150/296] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:14 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:14.511306 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-cfcd9df2-cd7c-42ab-9e06-2ddd935d2658 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:14.511852 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-cfcd9df2-cd7c-42ab-9e06-2ddd935d2658 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:14.518087 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-cfcd9df2-cd7c-42ab-9e06-2ddd935d2658 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:14.518541 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-cfcd9df2-cd7c-42ab-9e06-2ddd935d2658 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:14.519310 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-cfcd9df2-cd7c-42ab-9e06-2ddd935d2658 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:14.519756 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-cfcd9df2-cd7c-42ab-9e06-2ddd935d2658 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:14.529291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-006b09d1-7fa3-499b-b841-fc51b7bbf897 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:14.529920 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-006b09d1-7fa3-499b-b841-fc51b7bbf897 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:14.535821 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-006b09d1-7fa3-499b-b841-fc51b7bbf897 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:14.536265 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-006b09d1-7fa3-499b-b841-fc51b7bbf897 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:14.537191 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-006b09d1-7fa3-499b-b841-fc51b7bbf897 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:14.537632 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-006b09d1-7fa3-499b-b841-fc51b7bbf897 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:14.599591 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-006b09d1-7fa3-499b-b841-fc51b7bbf897 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:14.608173 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-006b09d1-7fa3-499b-b841-fc51b7bbf897 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1311 microversion: 2.1 time: 0.083097 May 23 15:32:14.608843 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 151/297] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:14 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1311 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:14.649788 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-cfcd9df2-cd7c-42ab-9e06-2ddd935d2658 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:14.657876 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-cfcd9df2-cd7c-42ab-9e06-2ddd935d2658 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.150465 May 23 15:32:14.658448 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 147/298] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:14 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:15.042995 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d5182e19-1893-4b6a-bdc4-c54242ec8192 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:15.043687 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d5182e19-1893-4b6a-bdc4-c54242ec8192 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:15.049910 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d5182e19-1893-4b6a-bdc4-c54242ec8192 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:15.050363 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d5182e19-1893-4b6a-bdc4-c54242ec8192 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:15.051134 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d5182e19-1893-4b6a-bdc4-c54242ec8192 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:15.051570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d5182e19-1893-4b6a-bdc4-c54242ec8192 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:15.177244 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d5182e19-1893-4b6a-bdc4-c54242ec8192 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:15.185279 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d5182e19-1893-4b6a-bdc4-c54242ec8192 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:15.186801 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d5182e19-1893-4b6a-bdc4-c54242ec8192 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:15.187966 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d5182e19-1893-4b6a-bdc4-c54242ec8192 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1745 microversion: 2.20 time: 0.149004 May 23 15:32:15.188527 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 152/299] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:15 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:15.366437 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b8ea2ad4-a0f6-4db4-b657-8cf52141d443 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:15.367014 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b8ea2ad4-a0f6-4db4-b657-8cf52141d443 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:15.374081 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b8ea2ad4-a0f6-4db4-b657-8cf52141d443 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:15.374532 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b8ea2ad4-a0f6-4db4-b657-8cf52141d443 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:15.375293 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b8ea2ad4-a0f6-4db4-b657-8cf52141d443 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:15.375727 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b8ea2ad4-a0f6-4db4-b657-8cf52141d443 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:15.505804 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b8ea2ad4-a0f6-4db4-b657-8cf52141d443 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:15.514144 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b8ea2ad4-a0f6-4db4-b657-8cf52141d443 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.151607 May 23 15:32:15.514712 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 148/300] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:15 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:15.625169 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b271745f-98d0-48ea-b53b-781800e81c6f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:15.625731 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b271745f-98d0-48ea-b53b-781800e81c6f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:15.628044 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:15.633602 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b271745f-98d0-48ea-b53b-781800e81c6f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:15.634060 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b271745f-98d0-48ea-b53b-781800e81c6f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:15.634854 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b271745f-98d0-48ea-b53b-781800e81c6f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:15.635297 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b271745f-98d0-48ea-b53b-781800e81c6f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:15.675318 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-76f3a5d1-dbee-41ec-91c6-ec5b1f76b79e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:15.675971 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-76f3a5d1-dbee-41ec-91c6-ec5b1f76b79e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:15.682137 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-76f3a5d1-dbee-41ec-91c6-ec5b1f76b79e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:15.682638 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-76f3a5d1-dbee-41ec-91c6-ec5b1f76b79e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:15.684095 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-76f3a5d1-dbee-41ec-91c6-ec5b1f76b79e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:15.684539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-76f3a5d1-dbee-41ec-91c6-ec5b1f76b79e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:15.700444 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b271745f-98d0-48ea-b53b-781800e81c6f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:15.707792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b271745f-98d0-48ea-b53b-781800e81c6f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1311 microversion: 2.1 time: 0.086612 May 23 15:32:15.708598 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 153/301] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:15 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:15.815781 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-76f3a5d1-dbee-41ec-91c6-ec5b1f76b79e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:15.823720 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-76f3a5d1-dbee-41ec-91c6-ec5b1f76b79e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.151652 May 23 15:32:15.824395 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 149/302] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:15 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:16.207469 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b93b3d1b-9063-4681-a12a-05416fa28234 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:16.208519 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b93b3d1b-9063-4681-a12a-05416fa28234 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:16.210507 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=12 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:16.218094 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b93b3d1b-9063-4681-a12a-05416fa28234 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:16.218829 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b93b3d1b-9063-4681-a12a-05416fa28234 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:16.219849 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b93b3d1b-9063-4681-a12a-05416fa28234 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:16.220478 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b93b3d1b-9063-4681-a12a-05416fa28234 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:16.349175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b93b3d1b-9063-4681-a12a-05416fa28234 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:16.357846 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b93b3d1b-9063-4681-a12a-05416fa28234 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:16.359354 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b93b3d1b-9063-4681-a12a-05416fa28234 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:16.360521 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b93b3d1b-9063-4681-a12a-05416fa28234 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1745 microversion: 2.20 time: 0.157569 May 23 15:32:16.361128 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 154/303] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:16 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:16.531643 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5e4696ae-d898-4e1c-926c-87e3fc1a6d31 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:16.532263 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-5e4696ae-d898-4e1c-926c-87e3fc1a6d31 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:16.538854 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5e4696ae-d898-4e1c-926c-87e3fc1a6d31 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:16.539305 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5e4696ae-d898-4e1c-926c-87e3fc1a6d31 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:16.540076 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5e4696ae-d898-4e1c-926c-87e3fc1a6d31 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:16.540510 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5e4696ae-d898-4e1c-926c-87e3fc1a6d31 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:16.667844 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-5e4696ae-d898-4e1c-926c-87e3fc1a6d31 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:16.675400 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5e4696ae-d898-4e1c-926c-87e3fc1a6d31 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.147659 May 23 15:32:16.676084 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 150/304] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:16 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:16.724902 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-e4c58a9c-7bf5-4331-a993-5d246d120e9a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:16.725421 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-e4c58a9c-7bf5-4331-a993-5d246d120e9a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:16.731937 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e4c58a9c-7bf5-4331-a993-5d246d120e9a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:16.732380 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e4c58a9c-7bf5-4331-a993-5d246d120e9a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:16.733167 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e4c58a9c-7bf5-4331-a993-5d246d120e9a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:16.733599 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e4c58a9c-7bf5-4331-a993-5d246d120e9a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:16.795599 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-e4c58a9c-7bf5-4331-a993-5d246d120e9a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:16.802862 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-e4c58a9c-7bf5-4331-a993-5d246d120e9a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1311 microversion: 2.1 time: 0.081930 May 23 15:32:16.803423 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 155/305] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:16 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1311 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:16.840558 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4cf62c10-5b78-46ba-ae21-51bd6688f9bb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:16.841199 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4cf62c10-5b78-46ba-ae21-51bd6688f9bb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:16.847349 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4cf62c10-5b78-46ba-ae21-51bd6688f9bb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:16.847962 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4cf62c10-5b78-46ba-ae21-51bd6688f9bb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:16.848587 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4cf62c10-5b78-46ba-ae21-51bd6688f9bb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:16.849059 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4cf62c10-5b78-46ba-ae21-51bd6688f9bb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:16.957677 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-36098f28-61f3-4242-9ab6-93261daa3d12 req-06eada57-9bb7-4408-a6aa-340d55a672bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9038c8-1395-4d48-b10b-2fe7310c4c76", "name": "network-vif-plugged", "status": "completed", "tag": "920328ed-01fa-4ed4-b496-7b1fea54b54c"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:32:16.967512 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-36098f28-61f3-4242-9ab6-93261daa3d12 req-06eada57-9bb7-4408-a6aa-340d55a672bb service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:16.968101 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-36098f28-61f3-4242-9ab6-93261daa3d12 req-06eada57-9bb7-4408-a6aa-340d55a672bb service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:16.980055 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-36098f28-61f3-4242-9ab6-93261daa3d12 req-06eada57-9bb7-4408-a6aa-340d55a672bb service nova] Creating event network-vif-plugged:920328ed-01fa-4ed4-b496-7b1fea54b54c for instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 on hv-cinder-84112 May 23 15:32:16.985511 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-36098f28-61f3-4242-9ab6-93261daa3d12 req-06eada57-9bb7-4408-a6aa-340d55a672bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031635 May 23 15:32:16.986619 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 156/306] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:32:16.991331 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4cf62c10-5b78-46ba-ae21-51bd6688f9bb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:16.999905 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4cf62c10-5b78-46ba-ae21-51bd6688f9bb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.163239 May 23 15:32:17.000473 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 151/307] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:16 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:17.379459 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-27289a18-6103-4aea-8377-683a4ea3a44a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:17.380154 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-27289a18-6103-4aea-8377-683a4ea3a44a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:17.386450 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-27289a18-6103-4aea-8377-683a4ea3a44a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:17.386903 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-27289a18-6103-4aea-8377-683a4ea3a44a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:17.387920 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-27289a18-6103-4aea-8377-683a4ea3a44a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:17.388357 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-27289a18-6103-4aea-8377-683a4ea3a44a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:17.616564 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-27289a18-6103-4aea-8377-683a4ea3a44a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:17.628479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-27289a18-6103-4aea-8377-683a4ea3a44a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:17.628479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-27289a18-6103-4aea-8377-683a4ea3a44a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:17.628786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-27289a18-6103-4aea-8377-683a4ea3a44a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1745 microversion: 2.20 time: 0.253468 May 23 15:32:17.629172 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 157/308] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:17 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1745 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:17.692363 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-761949b5-1f6f-4794-a757-7f96dce54e80 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:17.693026 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-761949b5-1f6f-4794-a757-7f96dce54e80 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:17.700299 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-761949b5-1f6f-4794-a757-7f96dce54e80 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:17.700749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-761949b5-1f6f-4794-a757-7f96dce54e80 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:17.701559 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-761949b5-1f6f-4794-a757-7f96dce54e80 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:17.701979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-761949b5-1f6f-4794-a757-7f96dce54e80 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:17.820226 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-013b8a3e-1044-4ce8-9d73-6e40e9f239dd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:17.821172 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-013b8a3e-1044-4ce8-9d73-6e40e9f239dd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:17.829738 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-013b8a3e-1044-4ce8-9d73-6e40e9f239dd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:17.830207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-013b8a3e-1044-4ce8-9d73-6e40e9f239dd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:17.831019 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-013b8a3e-1044-4ce8-9d73-6e40e9f239dd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:17.831648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-013b8a3e-1044-4ce8-9d73-6e40e9f239dd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:17.837616 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-761949b5-1f6f-4794-a757-7f96dce54e80 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:17.846861 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-761949b5-1f6f-4794-a757-7f96dce54e80 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.158125 May 23 15:32:17.847540 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 152/309] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:17 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:17.922257 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-013b8a3e-1044-4ce8-9d73-6e40e9f239dd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:17.931356 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-013b8a3e-1044-4ce8-9d73-6e40e9f239dd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1299 microversion: 2.1 time: 0.114926 May 23 15:32:17.941599 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 158/310] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:17 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:18.018052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d54edf6f-584e-4d09-8090-3cf7cc6e34e7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:18.018748 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d54edf6f-584e-4d09-8090-3cf7cc6e34e7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:18.025102 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d54edf6f-584e-4d09-8090-3cf7cc6e34e7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:18.025816 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d54edf6f-584e-4d09-8090-3cf7cc6e34e7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:18.027162 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d54edf6f-584e-4d09-8090-3cf7cc6e34e7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:18.027870 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d54edf6f-584e-4d09-8090-3cf7cc6e34e7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:18.185747 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d54edf6f-584e-4d09-8090-3cf7cc6e34e7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:18.195053 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d54edf6f-584e-4d09-8090-3cf7cc6e34e7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.180996 May 23 15:32:18.195839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 153/311] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:18 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:18.647455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-572c1ef2-fa48-47bf-be38-9b4e0596ee6d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:18.648062 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-572c1ef2-fa48-47bf-be38-9b4e0596ee6d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:18.658751 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-572c1ef2-fa48-47bf-be38-9b4e0596ee6d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:18.659411 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-572c1ef2-fa48-47bf-be38-9b4e0596ee6d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:18.660380 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-572c1ef2-fa48-47bf-be38-9b4e0596ee6d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:18.662163 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-572c1ef2-fa48-47bf-be38-9b4e0596ee6d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:18.865734 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8cfb5846-5639-4619-bdd5-4b5d3e77d5a9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:18.871917 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8cfb5846-5639-4619-bdd5-4b5d3e77d5a9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:18.884031 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8cfb5846-5639-4619-bdd5-4b5d3e77d5a9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:18.885175 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8cfb5846-5639-4619-bdd5-4b5d3e77d5a9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:18.886389 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8cfb5846-5639-4619-bdd5-4b5d3e77d5a9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:18.895092 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8cfb5846-5639-4619-bdd5-4b5d3e77d5a9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:18.896196 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-572c1ef2-fa48-47bf-be38-9b4e0596ee6d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:18.908446 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-572c1ef2-fa48-47bf-be38-9b4e0596ee6d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:18.910066 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-572c1ef2-fa48-47bf-be38-9b4e0596ee6d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:18.912059 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-572c1ef2-fa48-47bf-be38-9b4e0596ee6d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.268149 May 23 15:32:18.912912 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 159/312] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:18 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:18.951297 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-9349c3b6-a24f-4ea1-ad89-98b7a39acbd9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:18.952642 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-9349c3b6-a24f-4ea1-ad89-98b7a39acbd9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:18.960739 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9349c3b6-a24f-4ea1-ad89-98b7a39acbd9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:18.961483 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9349c3b6-a24f-4ea1-ad89-98b7a39acbd9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:18.962488 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9349c3b6-a24f-4ea1-ad89-98b7a39acbd9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:18.962948 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9349c3b6-a24f-4ea1-ad89-98b7a39acbd9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:19.069101 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-8cfb5846-5639-4619-bdd5-4b5d3e77d5a9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:19.078032 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8cfb5846-5639-4619-bdd5-4b5d3e77d5a9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.217469 May 23 15:32:19.079126 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 154/313] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:18 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:19.083719 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-80f15286-2253-49a5-8db8-ab272c08e946 req-fcfcb626-ec3e-48c7-9384-b18055e1d17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55f39cba-5943-42d5-9322-58f3af0d39f8", "name": "network-vif-plugged", "status": "completed", "tag": "d674721e-f3c3-41d6-99a3-5276229c8c17"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:32:19.093676 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-80f15286-2253-49a5-8db8-ab272c08e946 req-fcfcb626-ec3e-48c7-9384-b18055e1d17b service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:19.094050 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-80f15286-2253-49a5-8db8-ab272c08e946 req-fcfcb626-ec3e-48c7-9384-b18055e1d17b service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:19.107283 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-80f15286-2253-49a5-8db8-ab272c08e946 req-fcfcb626-ec3e-48c7-9384-b18055e1d17b service nova] Creating event network-vif-plugged:d674721e-f3c3-41d6-99a3-5276229c8c17 for instance 55f39cba-5943-42d5-9322-58f3af0d39f8 on hv-cinder-84112 May 23 15:32:19.114024 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-80f15286-2253-49a5-8db8-ab272c08e946 req-fcfcb626-ec3e-48c7-9384-b18055e1d17b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033375 May 23 15:32:19.114847 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 155/314] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:32:19.216178 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d6f33a86-9451-4b11-8aac-2e5cb193628d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:19.219725 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d6f33a86-9451-4b11-8aac-2e5cb193628d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:19.233860 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d6f33a86-9451-4b11-8aac-2e5cb193628d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:19.233860 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d6f33a86-9451-4b11-8aac-2e5cb193628d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:19.234550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d6f33a86-9451-4b11-8aac-2e5cb193628d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:19.236134 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d6f33a86-9451-4b11-8aac-2e5cb193628d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:19.249090 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9349c3b6-a24f-4ea1-ad89-98b7a39acbd9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:19.253344 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=100 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:19.266933 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-9349c3b6-a24f-4ea1-ad89-98b7a39acbd9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.321381 May 23 15:32:19.269185 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 160/315] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:18 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:19.278770 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=100 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:19.287737 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-84acd885-1409-46ed-8bae-f19031a3bb4a req-80296f20-8199-45a0-9afe-f40ab5a218ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc0f4046-cea9-4426-9970-4ff8f307a3c0", "tag": "5ecea450-0a05-473a-b7b2-1cd3cef1fd28"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:32:19.300696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-84acd885-1409-46ed-8bae-f19031a3bb4a req-80296f20-8199-45a0-9afe-f40ab5a218ee service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:19.301715 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-84acd885-1409-46ed-8bae-f19031a3bb4a req-80296f20-8199-45a0-9afe-f40ab5a218ee service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:19.338571 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-84acd885-1409-46ed-8bae-f19031a3bb4a req-80296f20-8199-45a0-9afe-f40ab5a218ee service nova] Creating event network-changed:5ecea450-0a05-473a-b7b2-1cd3cef1fd28 for instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 on hv-cinder-84112 May 23 15:32:19.345823 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-84acd885-1409-46ed-8bae-f19031a3bb4a req-80296f20-8199-45a0-9afe-f40ab5a218ee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063955 May 23 15:32:19.346778 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 161/316] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:32:19.428826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d6f33a86-9451-4b11-8aac-2e5cb193628d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:19.439097 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d6f33a86-9451-4b11-8aac-2e5cb193628d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.230887 May 23 15:32:19.439854 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 156/317] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:19 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:19.933342 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8eb43aa4-4fd2-4bb2-93b9-847268cf6d25 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:19.934074 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8eb43aa4-4fd2-4bb2-93b9-847268cf6d25 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:19.944083 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8eb43aa4-4fd2-4bb2-93b9-847268cf6d25 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:19.944451 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8eb43aa4-4fd2-4bb2-93b9-847268cf6d25 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:19.945248 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8eb43aa4-4fd2-4bb2-93b9-847268cf6d25 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:19.945883 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8eb43aa4-4fd2-4bb2-93b9-847268cf6d25 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:20.100243 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4c736142-8884-471d-adf8-1eeddd01b729 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:20.101868 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4c736142-8884-471d-adf8-1eeddd01b729 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:20.110737 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c736142-8884-471d-adf8-1eeddd01b729 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:20.111425 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c736142-8884-471d-adf8-1eeddd01b729 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:20.112541 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c736142-8884-471d-adf8-1eeddd01b729 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:20.113989 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c736142-8884-471d-adf8-1eeddd01b729 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:20.289610 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4c736142-8884-471d-adf8-1eeddd01b729 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:20.299614 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4c736142-8884-471d-adf8-1eeddd01b729 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.205686 May 23 15:32:20.303704 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 157/318] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:20 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:20.309779 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-42afac55-2670-4397-ae12-313be16b7658 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:20.310867 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-42afac55-2670-4397-ae12-313be16b7658 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:20.318421 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-42afac55-2670-4397-ae12-313be16b7658 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:20.319722 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-42afac55-2670-4397-ae12-313be16b7658 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:20.321729 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-42afac55-2670-4397-ae12-313be16b7658 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:20.322404 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-42afac55-2670-4397-ae12-313be16b7658 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:20.603736 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-42afac55-2670-4397-ae12-313be16b7658 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:20.619592 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-42afac55-2670-4397-ae12-313be16b7658 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.312981 May 23 15:32:20.629499 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 158/319] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:20 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:20.640173 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-68e4b065-01e1-4503-9b21-dfe81ae33c38 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:20.641251 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-68e4b065-01e1-4503-9b21-dfe81ae33c38 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:20.653044 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-68e4b065-01e1-4503-9b21-dfe81ae33c38 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:20.653622 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-68e4b065-01e1-4503-9b21-dfe81ae33c38 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:20.654712 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-68e4b065-01e1-4503-9b21-dfe81ae33c38 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:20.657165 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-68e4b065-01e1-4503-9b21-dfe81ae33c38 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:20.664812 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8eb43aa4-4fd2-4bb2-93b9-847268cf6d25 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:20.683721 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8eb43aa4-4fd2-4bb2-93b9-847268cf6d25 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:20.688630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8eb43aa4-4fd2-4bb2-93b9-847268cf6d25 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:20.694936 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8eb43aa4-4fd2-4bb2-93b9-847268cf6d25 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.766915 May 23 15:32:20.697919 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 162/320] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:19 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:20.911123 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-68e4b065-01e1-4503-9b21-dfe81ae33c38 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:20.919855 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-68e4b065-01e1-4503-9b21-dfe81ae33c38 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1503 microversion: 2.1 time: 0.289025 May 23 15:32:20.921387 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 159/321] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:20 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1503 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:20.937986 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-584d49c4-cbf7-44f4-a9b6-9773ff6b01b5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3987205-e66a-4f27-a227-3be679dd6fe3"}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:32:20.940767 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-584d49c4-cbf7-44f4-a9b6-9773ff6b01b5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:20.949557 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-584d49c4-cbf7-44f4-a9b6-9773ff6b01b5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:20.950494 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-584d49c4-cbf7-44f4-a9b6-9773ff6b01b5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:20.951440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-584d49c4-cbf7-44f4-a9b6-9773ff6b01b5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:20.951938 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-584d49c4-cbf7-44f4-a9b6-9773ff6b01b5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:20.994004 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-584d49c4-cbf7-44f4-a9b6-9773ff6b01b5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] HTTP exception thrown: Cannot 'attach_volume' instance 40f940d7-a17e-4271-9326-70a868f80e59 while it is in vm_state rescued May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-584d49c4-cbf7-44f4-a9b6-9773ff6b01b5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Request method failure captured: May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: POST /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59/os-volume_attachments HTTP/1.1 May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 74 May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6h-A5hbnr5tRX4j7z_Fo2SkNdX-EO3Ww9aps-yabims8fjFdE2KLn43LVxISco1aI6PJe4GKJ_4L1myusbRV8rLv7u1bxIgWrbgq5gXl0OhYXPQF8QPoudR53EbpJbeSIsHyVZJNXRpJlD2FdoebyscshU-JjudZe-a7dzSa1AlnJ8 May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: 0712b807a4584f7b8f019ceb65ff1e14 May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1966403117 May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:32:20.998540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:32:21.000470 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0712b807a4584f7b8f019ceb65ff1e14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0712b807a4584f7b8f019ceb65ff1e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0712b807a4584f7b8f019ceb65ff1e14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0712b807a4584f7b8f019ceb65ff1e14", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:32:21.000470 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1966403117 May 23 15:32:21.000470 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: 0712b807a4584f7b8f019ceb65ff1e14 May 23 15:32:21.000470 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1966403117 May 23 15:32:21.000470 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-ServerRescueNegativeTestJSON-1966403117-project May 23 15:32:21.000470 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:32:21.000470 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:32:21.000470 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: 5074b9fa045543b9a62bf751e736d0df May 23 15:32:21.000470 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1966403117-project May 23 15:32:21.000470 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: May 23 15:32:21.000470 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {"volumeAttachment": {"volumeId": "c3987205-e66a-4f27-a227-3be679dd6fe3"}} May 23 15:32:21.000470 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Cannot 'attach_volume' instance 40f940d7-a17e-4271-9326-70a868f80e59 while it is in vm_state rescued May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'server_id': '40f940d7-a17e-4271-9326-70a868f80e59', 'body': {'volumeAttachment': {'volumeId': 'c3987205-e66a-4f27-a227-3be679dd6fe3'}}} May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 40f940d7-a17e-4271-9326-70a868f80e59 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:32:21.001567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 40f940d7-a17e-4271-9326-70a868f80e59 while it is in vm_state rescued May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:32:21.003160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:32:21.004764 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:32:21.004764 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:32:21.004764 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 40f940d7-a17e-4271-9326-70a868f80e59 while it is in vm_state rescued May 23 15:32:21.004764 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:32:21.008341 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-584d49c4-cbf7-44f4-a9b6-9773ff6b01b5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Returning 409 to user: Cannot 'attach_volume' instance 40f940d7-a17e-4271-9326-70a868f80e59 while it is in vm_state rescued {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:32:21.009643 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-584d49c4-cbf7-44f4-a9b6-9773ff6b01b5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "POST /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.077536 May 23 15:32:21.010787 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 163/322] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 15:32:20 2022] POST /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59/os-volume_attachments => generated 152 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 15:32:21.019430 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8f763a7b-84e5-407b-88bf-d2b76d8695e6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:32:21.019985 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8f763a7b-84e5-407b-88bf-d2b76d8695e6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:21.029860 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8f763a7b-84e5-407b-88bf-d2b76d8695e6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:21.033668 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8f763a7b-84e5-407b-88bf-d2b76d8695e6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:21.035024 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8f763a7b-84e5-407b-88bf-d2b76d8695e6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:21.035628 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8f763a7b-84e5-407b-88bf-d2b76d8695e6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:21.131752 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8f763a7b-84e5-407b-88bf-d2b76d8695e6 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "POST /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59/action" status: 202 len: 0 microversion: 2.1 time: 0.115844 May 23 15:32:21.132482 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 160/323] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 15:32:21 2022] POST /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:32:21.141846 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-37873612-6021-4d5f-a2d9-e39a65a40c77 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:21.142715 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-37873612-6021-4d5f-a2d9-e39a65a40c77 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:21.153179 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-37873612-6021-4d5f-a2d9-e39a65a40c77 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:21.153754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-37873612-6021-4d5f-a2d9-e39a65a40c77 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:21.154633 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-37873612-6021-4d5f-a2d9-e39a65a40c77 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:21.155163 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-37873612-6021-4d5f-a2d9-e39a65a40c77 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:21.317540 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d8f3cb75-aafa-41af-acaf-5d42f9525271 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:21.318260 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d8f3cb75-aafa-41af-acaf-5d42f9525271 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:21.326976 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d8f3cb75-aafa-41af-acaf-5d42f9525271 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:21.327699 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d8f3cb75-aafa-41af-acaf-5d42f9525271 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:21.328884 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d8f3cb75-aafa-41af-acaf-5d42f9525271 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:21.329578 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d8f3cb75-aafa-41af-acaf-5d42f9525271 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:21.364734 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-37873612-6021-4d5f-a2d9-e39a65a40c77 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:21.375009 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-37873612-6021-4d5f-a2d9-e39a65a40c77 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.237704 May 23 15:32:21.376051 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 164/324] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:21 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:21.597974 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d8f3cb75-aafa-41af-acaf-5d42f9525271 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:21.612958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d8f3cb75-aafa-41af-acaf-5d42f9525271 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.295790 May 23 15:32:21.612958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 161/325] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:21 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:21.636024 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a539d904-f511-4dc9-9763-ba0c697669f3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:21.636719 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-a539d904-f511-4dc9-9763-ba0c697669f3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:21.647273 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a539d904-f511-4dc9-9763-ba0c697669f3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:21.648509 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a539d904-f511-4dc9-9763-ba0c697669f3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:21.649532 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a539d904-f511-4dc9-9763-ba0c697669f3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:21.650154 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a539d904-f511-4dc9-9763-ba0c697669f3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:21.716301 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e60cebdb-946a-4a04-b698-b72e5af0a2fa tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:21.717420 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e60cebdb-946a-4a04-b698-b72e5af0a2fa tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:21.729691 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e60cebdb-946a-4a04-b698-b72e5af0a2fa tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:21.730923 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e60cebdb-946a-4a04-b698-b72e5af0a2fa tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:21.731946 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e60cebdb-946a-4a04-b698-b72e5af0a2fa tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:21.732464 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e60cebdb-946a-4a04-b698-b72e5af0a2fa tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:21.982310 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e60cebdb-946a-4a04-b698-b72e5af0a2fa tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:21.993001 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e60cebdb-946a-4a04-b698-b72e5af0a2fa tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:21.994513 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e60cebdb-946a-4a04-b698-b72e5af0a2fa tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:22.013030 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e60cebdb-946a-4a04-b698-b72e5af0a2fa tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.301505 May 23 15:32:22.013606 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 162/326] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:21 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:22.075825 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a539d904-f511-4dc9-9763-ba0c697669f3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:22.094014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a539d904-f511-4dc9-9763-ba0c697669f3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.462171 May 23 15:32:22.094603 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 165/327] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:21 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:22.397452 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-856a7647-875c-4e27-bd8c-da56370c9208 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:22.399625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-856a7647-875c-4e27-bd8c-da56370c9208 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:22.407299 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-856a7647-875c-4e27-bd8c-da56370c9208 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:22.407755 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-856a7647-875c-4e27-bd8c-da56370c9208 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:22.408538 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-856a7647-875c-4e27-bd8c-da56370c9208 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:22.409174 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-856a7647-875c-4e27-bd8c-da56370c9208 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:22.602005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-856a7647-875c-4e27-bd8c-da56370c9208 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:22.616671 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-856a7647-875c-4e27-bd8c-da56370c9208 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.227680 May 23 15:32:22.617763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 163/328] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:22 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:22.635434 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-45b8b403-7ab2-4efb-bbcd-61b9df6458f5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:22.636313 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-45b8b403-7ab2-4efb-bbcd-61b9df6458f5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:22.643292 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-45b8b403-7ab2-4efb-bbcd-61b9df6458f5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:22.643838 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-45b8b403-7ab2-4efb-bbcd-61b9df6458f5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:22.644679 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-45b8b403-7ab2-4efb-bbcd-61b9df6458f5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:22.645268 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-45b8b403-7ab2-4efb-bbcd-61b9df6458f5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:22.794385 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-45b8b403-7ab2-4efb-bbcd-61b9df6458f5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:22.804920 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-45b8b403-7ab2-4efb-bbcd-61b9df6458f5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.172930 May 23 15:32:22.806682 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 166/329] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:22 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:23.031607 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-118b31da-9ef5-4c98-b3ba-9b56985f70a2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:23.032259 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-118b31da-9ef5-4c98-b3ba-9b56985f70a2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:23.039370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-118b31da-9ef5-4c98-b3ba-9b56985f70a2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:23.039829 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-118b31da-9ef5-4c98-b3ba-9b56985f70a2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:23.040685 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-118b31da-9ef5-4c98-b3ba-9b56985f70a2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:23.041193 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-118b31da-9ef5-4c98-b3ba-9b56985f70a2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:23.112603 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-0d99ee54-bf1a-42a9-b463-1c8f33eb6bd6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:23.115468 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-0d99ee54-bf1a-42a9-b463-1c8f33eb6bd6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:23.128439 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0d99ee54-bf1a-42a9-b463-1c8f33eb6bd6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:23.129344 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0d99ee54-bf1a-42a9-b463-1c8f33eb6bd6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:23.130709 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0d99ee54-bf1a-42a9-b463-1c8f33eb6bd6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:23.131773 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0d99ee54-bf1a-42a9-b463-1c8f33eb6bd6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:23.218943 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-118b31da-9ef5-4c98-b3ba-9b56985f70a2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:23.263162 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-118b31da-9ef5-4c98-b3ba-9b56985f70a2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:23.265998 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-118b31da-9ef5-4c98-b3ba-9b56985f70a2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:23.268030 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-118b31da-9ef5-4c98-b3ba-9b56985f70a2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.240163 May 23 15:32:23.269427 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 164/330] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:23 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:32:23.343959 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-0d99ee54-bf1a-42a9-b463-1c8f33eb6bd6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:23.352778 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-0d99ee54-bf1a-42a9-b463-1c8f33eb6bd6 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.244117 May 23 15:32:23.353229 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 167/331] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:23 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:23.640144 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5ffca69f-3357-4210-937f-afcfe50a94fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:23.641389 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-5ffca69f-3357-4210-937f-afcfe50a94fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:23.648121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5ffca69f-3357-4210-937f-afcfe50a94fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:23.648932 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5ffca69f-3357-4210-937f-afcfe50a94fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:23.649706 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5ffca69f-3357-4210-937f-afcfe50a94fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:23.650312 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5ffca69f-3357-4210-937f-afcfe50a94fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:23.794461 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-5ffca69f-3357-4210-937f-afcfe50a94fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:23.804635 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5ffca69f-3357-4210-937f-afcfe50a94fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.168944 May 23 15:32:23.805780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 165/332] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:23 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:23.822928 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3991b2f2-e120-44ba-9b3f-b94160d0bf8f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:23.824076 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-3991b2f2-e120-44ba-9b3f-b94160d0bf8f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:23.830535 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3991b2f2-e120-44ba-9b3f-b94160d0bf8f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:23.831186 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3991b2f2-e120-44ba-9b3f-b94160d0bf8f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:23.832117 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3991b2f2-e120-44ba-9b3f-b94160d0bf8f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:23.832736 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3991b2f2-e120-44ba-9b3f-b94160d0bf8f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:23.997788 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3991b2f2-e120-44ba-9b3f-b94160d0bf8f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:24.005693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-3991b2f2-e120-44ba-9b3f-b94160d0bf8f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.186914 May 23 15:32:24.006440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 168/333] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:23 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:24.287126 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3e2e005f-0a24-4c11-9179-0bab6c9b2f6a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:24.287972 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3e2e005f-0a24-4c11-9179-0bab6c9b2f6a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:24.298957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3e2e005f-0a24-4c11-9179-0bab6c9b2f6a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:24.299415 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3e2e005f-0a24-4c11-9179-0bab6c9b2f6a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:24.303780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3e2e005f-0a24-4c11-9179-0bab6c9b2f6a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:24.304247 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3e2e005f-0a24-4c11-9179-0bab6c9b2f6a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:24.378451 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-664de366-f77f-4578-b5f8-2e7e780ceb53 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:24.379071 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-664de366-f77f-4578-b5f8-2e7e780ceb53 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:24.387111 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-664de366-f77f-4578-b5f8-2e7e780ceb53 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:24.387556 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-664de366-f77f-4578-b5f8-2e7e780ceb53 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:24.388787 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-664de366-f77f-4578-b5f8-2e7e780ceb53 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:24.389406 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-664de366-f77f-4578-b5f8-2e7e780ceb53 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:24.464392 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3e2e005f-0a24-4c11-9179-0bab6c9b2f6a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:24.473372 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3e2e005f-0a24-4c11-9179-0bab6c9b2f6a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:24.475038 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3e2e005f-0a24-4c11-9179-0bab6c9b2f6a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:24.476298 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3e2e005f-0a24-4c11-9179-0bab6c9b2f6a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.193671 May 23 15:32:24.478157 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 166/334] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:24 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:24.536021 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-664de366-f77f-4578-b5f8-2e7e780ceb53 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:24.543884 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-664de366-f77f-4578-b5f8-2e7e780ceb53 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.169223 May 23 15:32:24.544451 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 169/335] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:24 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:24.821793 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2d1e300e-5b36-42ca-98bb-72ea85a63c2a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:24.822997 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-2d1e300e-5b36-42ca-98bb-72ea85a63c2a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:24.830037 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2d1e300e-5b36-42ca-98bb-72ea85a63c2a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:24.830489 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2d1e300e-5b36-42ca-98bb-72ea85a63c2a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:24.831289 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2d1e300e-5b36-42ca-98bb-72ea85a63c2a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:24.831719 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2d1e300e-5b36-42ca-98bb-72ea85a63c2a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:24.971366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-2d1e300e-5b36-42ca-98bb-72ea85a63c2a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:24.982255 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-2d1e300e-5b36-42ca-98bb-72ea85a63c2a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.164095 May 23 15:32:24.982988 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 167/336] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:24 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:25.028998 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-95434ba1-f4cf-4f16-ba6f-4081e05f99fc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:25.029863 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-95434ba1-f4cf-4f16-ba6f-4081e05f99fc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:25.036236 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-95434ba1-f4cf-4f16-ba6f-4081e05f99fc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:25.036681 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-95434ba1-f4cf-4f16-ba6f-4081e05f99fc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:25.037476 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-95434ba1-f4cf-4f16-ba6f-4081e05f99fc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:25.037912 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-95434ba1-f4cf-4f16-ba6f-4081e05f99fc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:25.177473 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-95434ba1-f4cf-4f16-ba6f-4081e05f99fc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:25.186132 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-95434ba1-f4cf-4f16-ba6f-4081e05f99fc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1358 microversion: 2.1 time: 0.161219 May 23 15:32:25.195564 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 170/337] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:25 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:25.494324 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-508d7a7c-9ffa-40d9-b74e-53be6587a88e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:25.495274 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-508d7a7c-9ffa-40d9-b74e-53be6587a88e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:25.502354 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-508d7a7c-9ffa-40d9-b74e-53be6587a88e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:25.502985 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-508d7a7c-9ffa-40d9-b74e-53be6587a88e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:25.503937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-508d7a7c-9ffa-40d9-b74e-53be6587a88e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:25.504378 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-508d7a7c-9ffa-40d9-b74e-53be6587a88e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:25.561471 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c8325fa1-7fe6-49b3-8b73-901bb777c9bc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:25.562092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c8325fa1-7fe6-49b3-8b73-901bb777c9bc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:25.568364 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c8325fa1-7fe6-49b3-8b73-901bb777c9bc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:25.569081 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c8325fa1-7fe6-49b3-8b73-901bb777c9bc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:25.570046 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c8325fa1-7fe6-49b3-8b73-901bb777c9bc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:25.570639 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c8325fa1-7fe6-49b3-8b73-901bb777c9bc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:25.685750 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-508d7a7c-9ffa-40d9-b74e-53be6587a88e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:25.696147 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-508d7a7c-9ffa-40d9-b74e-53be6587a88e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:25.697913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-508d7a7c-9ffa-40d9-b74e-53be6587a88e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:25.699991 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-508d7a7c-9ffa-40d9-b74e-53be6587a88e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.209745 May 23 15:32:25.701086 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 168/338] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:25 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:25.759149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c8325fa1-7fe6-49b3-8b73-901bb777c9bc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:25.769103 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c8325fa1-7fe6-49b3-8b73-901bb777c9bc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.212112 May 23 15:32:25.779219 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 171/339] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:25 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:25.999463 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b0808129-1265-40e5-9453-5c03421cf144 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:26.000128 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b0808129-1265-40e5-9453-5c03421cf144 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:26.006899 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b0808129-1265-40e5-9453-5c03421cf144 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:26.007353 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b0808129-1265-40e5-9453-5c03421cf144 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:26.008136 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b0808129-1265-40e5-9453-5c03421cf144 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:26.008576 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b0808129-1265-40e5-9453-5c03421cf144 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:26.155193 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b0808129-1265-40e5-9453-5c03421cf144 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:26.166631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b0808129-1265-40e5-9453-5c03421cf144 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.171510 May 23 15:32:26.168306 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 169/340] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:25 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:26.205496 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ccb04043-d097-489b-b4f8-a94cc112d3c5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:26.206112 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ccb04043-d097-489b-b4f8-a94cc112d3c5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:26.212804 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ccb04043-d097-489b-b4f8-a94cc112d3c5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:26.213280 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ccb04043-d097-489b-b4f8-a94cc112d3c5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:26.214085 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ccb04043-d097-489b-b4f8-a94cc112d3c5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:26.214516 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ccb04043-d097-489b-b4f8-a94cc112d3c5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:26.360460 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ccb04043-d097-489b-b4f8-a94cc112d3c5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:26.368730 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ccb04043-d097-489b-b4f8-a94cc112d3c5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1547 microversion: 2.1 time: 0.169580 May 23 15:32:26.369509 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 172/341] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:26 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:26.388569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5adb8ade-7009-408d-a5e3-a3185658dcff tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:26.389216 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-5adb8ade-7009-408d-a5e3-a3185658dcff tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:26.395182 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5adb8ade-7009-408d-a5e3-a3185658dcff tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:26.395833 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5adb8ade-7009-408d-a5e3-a3185658dcff tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:26.397139 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5adb8ade-7009-408d-a5e3-a3185658dcff tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:26.397814 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5adb8ade-7009-408d-a5e3-a3185658dcff tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:26.563529 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-5adb8ade-7009-408d-a5e3-a3185658dcff tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:26.571213 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5adb8ade-7009-408d-a5e3-a3185658dcff tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1547 microversion: 2.1 time: 0.187041 May 23 15:32:26.582375 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 170/342] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:26 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1547 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:26.592741 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-495fa147-6919-4969-a6fa-258e7056cdc5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:26.596759 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-495fa147-6919-4969-a6fa-258e7056cdc5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:26.602848 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-495fa147-6919-4969-a6fa-258e7056cdc5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Searching by: {'deleted': False, 'project_id': '591802cf5c044932940307866f388790'} {{(pid=117973) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 23 15:32:26.617857 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-495fa147-6919-4969-a6fa-258e7056cdc5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:26.618714 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-495fa147-6919-4969-a6fa-258e7056cdc5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:26.619673 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-495fa147-6919-4969-a6fa-258e7056cdc5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:26.621117 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-495fa147-6919-4969-a6fa-258e7056cdc5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:26.721053 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-baf120b4-a7f5-46a2-a171-6b7a56a97d97 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:26.721922 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-baf120b4-a7f5-46a2-a171-6b7a56a97d97 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:26.729136 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-baf120b4-a7f5-46a2-a171-6b7a56a97d97 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:26.730090 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-baf120b4-a7f5-46a2-a171-6b7a56a97d97 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:26.731101 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-baf120b4-a7f5-46a2-a171-6b7a56a97d97 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:26.731749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-baf120b4-a7f5-46a2-a171-6b7a56a97d97 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:26.733456 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.multi_cell_list [None req-495fa147-6919-4969-a6fa-258e7056cdc5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117973) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 23 15:32:26.883217 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-baf120b4-a7f5-46a2-a171-6b7a56a97d97 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:26.893144 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-baf120b4-a7f5-46a2-a171-6b7a56a97d97 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:26.894675 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-baf120b4-a7f5-46a2-a171-6b7a56a97d97 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:26.895860 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-baf120b4-a7f5-46a2-a171-6b7a56a97d97 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.180167 May 23 15:32:26.896773 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 171/343] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:26 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:32:26.901736 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-451cd130-d5a9-445f-913f-e56f435ce8e9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:26.902358 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-451cd130-d5a9-445f-913f-e56f435ce8e9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:26.903151 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-495fa147-6919-4969-a6fa-258e7056cdc5 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.315601 May 23 15:32:26.904471 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 173/344] 10.222.0.30 () {58 vars in 1124 bytes} [Mon May 23 15:32:26 2022] GET /compute/v2.1/servers => generated 343 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:32:26.909310 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-451cd130-d5a9-445f-913f-e56f435ce8e9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:26.909774 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-451cd130-d5a9-445f-913f-e56f435ce8e9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:26.910708 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-451cd130-d5a9-445f-913f-e56f435ce8e9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:26.911147 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-451cd130-d5a9-445f-913f-e56f435ce8e9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:26.914484 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:26.919842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ddeaed34-b9fd-4c9b-87d9-e072c93b7f97 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:26.921296 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ddeaed34-b9fd-4c9b-87d9-e072c93b7f97 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:26.932150 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ddeaed34-b9fd-4c9b-87d9-e072c93b7f97 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:26.933025 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ddeaed34-b9fd-4c9b-87d9-e072c93b7f97 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:26.934353 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ddeaed34-b9fd-4c9b-87d9-e072c93b7f97 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:26.935049 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ddeaed34-b9fd-4c9b-87d9-e072c93b7f97 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:27.113264 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ddeaed34-b9fd-4c9b-87d9-e072c93b7f97 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:27.121512 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ddeaed34-b9fd-4c9b-87d9-e072c93b7f97 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1547 microversion: 2.1 time: 0.206850 May 23 15:32:27.122084 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 174/345] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:26 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1547 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:27.123837 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-451cd130-d5a9-445f-913f-e56f435ce8e9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:27.131693 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-451cd130-d5a9-445f-913f-e56f435ce8e9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.233939 May 23 15:32:27.132481 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 172/346] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:26 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:27.188348 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-24237be2-5915-40c7-ac6a-fb229249d8e9 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:27.188348 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-24237be2-5915-40c7-ac6a-fb229249d8e9 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:27.189571 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:27.194820 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-24237be2-5915-40c7-ac6a-fb229249d8e9 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:27.197294 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-24237be2-5915-40c7-ac6a-fb229249d8e9 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:27.199452 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-24237be2-5915-40c7-ac6a-fb229249d8e9 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:27.199980 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-24237be2-5915-40c7-ac6a-fb229249d8e9 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:27.371327 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-24237be2-5915-40c7-ac6a-fb229249d8e9 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:27.379829 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-24237be2-5915-40c7-ac6a-fb229249d8e9 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.200002 May 23 15:32:27.380719 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 175/347] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:27 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:27.924545 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-86835df9-cc9b-4959-a674-504fbda9e2bf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:27.925196 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-86835df9-cc9b-4959-a674-504fbda9e2bf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:27.937270 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-86835df9-cc9b-4959-a674-504fbda9e2bf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:27.937819 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-86835df9-cc9b-4959-a674-504fbda9e2bf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:27.938839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-86835df9-cc9b-4959-a674-504fbda9e2bf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:27.939335 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-86835df9-cc9b-4959-a674-504fbda9e2bf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:28.122636 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-86835df9-cc9b-4959-a674-504fbda9e2bf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:28.130652 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-86835df9-cc9b-4959-a674-504fbda9e2bf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:28.135012 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-86835df9-cc9b-4959-a674-504fbda9e2bf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:28.138263 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-86835df9-cc9b-4959-a674-504fbda9e2bf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.217133 May 23 15:32:28.156326 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-cf45684d-5e18-4c24-b713-9e0a31b2ab6a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:28.157574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-cf45684d-5e18-4c24-b713-9e0a31b2ab6a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:28.160769 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 173/348] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:27 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:28.164100 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cf45684d-5e18-4c24-b713-9e0a31b2ab6a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:28.164730 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cf45684d-5e18-4c24-b713-9e0a31b2ab6a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:28.165827 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cf45684d-5e18-4c24-b713-9e0a31b2ab6a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:28.166417 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cf45684d-5e18-4c24-b713-9e0a31b2ab6a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:28.314589 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-cf45684d-5e18-4c24-b713-9e0a31b2ab6a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:28.325702 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-cf45684d-5e18-4c24-b713-9e0a31b2ab6a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.175600 May 23 15:32:28.326399 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 176/349] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:28 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:28.397696 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-6f856924-3c50-4edf-b94d-2145d65b0090 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:28.398391 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-6f856924-3c50-4edf-b94d-2145d65b0090 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:28.405463 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6f856924-3c50-4edf-b94d-2145d65b0090 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:28.406035 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6f856924-3c50-4edf-b94d-2145d65b0090 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:28.407036 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6f856924-3c50-4edf-b94d-2145d65b0090 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:28.407464 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6f856924-3c50-4edf-b94d-2145d65b0090 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:28.547786 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-6f856924-3c50-4edf-b94d-2145d65b0090 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:28.557792 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-6f856924-3c50-4edf-b94d-2145d65b0090 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.164154 May 23 15:32:28.558919 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 174/350] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:28 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:29.155721 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5a38f2ef-672f-49cd-8cb0-93a1afb7acbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:29.156361 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-5a38f2ef-672f-49cd-8cb0-93a1afb7acbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:29.162421 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5a38f2ef-672f-49cd-8cb0-93a1afb7acbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:29.162867 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5a38f2ef-672f-49cd-8cb0-93a1afb7acbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:29.163622 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5a38f2ef-672f-49cd-8cb0-93a1afb7acbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:29.164056 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5a38f2ef-672f-49cd-8cb0-93a1afb7acbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:29.315737 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-5a38f2ef-672f-49cd-8cb0-93a1afb7acbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:29.331804 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-5a38f2ef-672f-49cd-8cb0-93a1afb7acbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:29.333596 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-5a38f2ef-672f-49cd-8cb0-93a1afb7acbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:29.334945 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-5a38f2ef-672f-49cd-8cb0-93a1afb7acbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.183165 May 23 15:32:29.335494 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 177/351] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:29 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:32:29.341694 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d43098e8-24ee-4f4e-8710-0fba3a319aa0 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:29.342298 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d43098e8-24ee-4f4e-8710-0fba3a319aa0 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:29.353166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d43098e8-24ee-4f4e-8710-0fba3a319aa0 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:29.353635 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d43098e8-24ee-4f4e-8710-0fba3a319aa0 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:29.355435 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d43098e8-24ee-4f4e-8710-0fba3a319aa0 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:29.356021 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d43098e8-24ee-4f4e-8710-0fba3a319aa0 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:29.512842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d43098e8-24ee-4f4e-8710-0fba3a319aa0 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:29.521320 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d43098e8-24ee-4f4e-8710-0fba3a319aa0 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.183295 May 23 15:32:29.528266 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 175/352] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:29 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:29.575163 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a04dfce2-cd8f-42ad-bdd7-9a2bb38aad61 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:29.575881 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-a04dfce2-cd8f-42ad-bdd7-9a2bb38aad61 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:29.582350 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a04dfce2-cd8f-42ad-bdd7-9a2bb38aad61 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:29.583047 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a04dfce2-cd8f-42ad-bdd7-9a2bb38aad61 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:29.583837 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a04dfce2-cd8f-42ad-bdd7-9a2bb38aad61 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:29.584279 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a04dfce2-cd8f-42ad-bdd7-9a2bb38aad61 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:29.587254 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=100 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:29.760095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a04dfce2-cd8f-42ad-bdd7-9a2bb38aad61 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:29.768293 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a04dfce2-cd8f-42ad-bdd7-9a2bb38aad61 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.197124 May 23 15:32:29.768880 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 178/353] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:29 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:30.354059 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-1edb0e4d-3382-4166-acb0-941b9aef97fb tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:30.355365 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-1edb0e4d-3382-4166-acb0-941b9aef97fb tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:30.361798 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1edb0e4d-3382-4166-acb0-941b9aef97fb tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:30.362246 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1edb0e4d-3382-4166-acb0-941b9aef97fb tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:30.363011 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1edb0e4d-3382-4166-acb0-941b9aef97fb tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:30.363445 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1edb0e4d-3382-4166-acb0-941b9aef97fb tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:30.490245 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1edb0e4d-3382-4166-acb0-941b9aef97fb tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:30.498580 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1edb0e4d-3382-4166-acb0-941b9aef97fb tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:30.500088 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1edb0e4d-3382-4166-acb0-941b9aef97fb tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:30.501279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-1edb0e4d-3382-4166-acb0-941b9aef97fb tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.151106 May 23 15:32:30.501834 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 176/354] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:30 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:30.539434 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f14bc924-20de-4a73-b434-ec373edb8c36 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:30.540057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f14bc924-20de-4a73-b434-ec373edb8c36 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:30.547278 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f14bc924-20de-4a73-b434-ec373edb8c36 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:30.547765 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f14bc924-20de-4a73-b434-ec373edb8c36 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:30.548539 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f14bc924-20de-4a73-b434-ec373edb8c36 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:30.549015 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f14bc924-20de-4a73-b434-ec373edb8c36 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:30.681632 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f14bc924-20de-4a73-b434-ec373edb8c36 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:30.689703 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f14bc924-20de-4a73-b434-ec373edb8c36 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.154199 May 23 15:32:30.690300 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 179/355] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:30 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:30.785685 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-00cf04f7-4275-4c5f-8e73-319c8769f8ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:30.786301 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-00cf04f7-4275-4c5f-8e73-319c8769f8ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:30.793066 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-00cf04f7-4275-4c5f-8e73-319c8769f8ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:30.793527 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-00cf04f7-4275-4c5f-8e73-319c8769f8ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:30.794303 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-00cf04f7-4275-4c5f-8e73-319c8769f8ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:30.794743 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-00cf04f7-4275-4c5f-8e73-319c8769f8ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:30.924046 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-00cf04f7-4275-4c5f-8e73-319c8769f8ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:30.931852 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-00cf04f7-4275-4c5f-8e73-319c8769f8ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.149999 May 23 15:32:30.932463 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 177/356] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:30 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:31.519914 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8ca5a093-6885-43b6-9e8f-22671b9a46df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:31.520527 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8ca5a093-6885-43b6-9e8f-22671b9a46df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:31.526695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8ca5a093-6885-43b6-9e8f-22671b9a46df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:31.527100 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8ca5a093-6885-43b6-9e8f-22671b9a46df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:31.527860 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8ca5a093-6885-43b6-9e8f-22671b9a46df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:31.528298 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8ca5a093-6885-43b6-9e8f-22671b9a46df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:31.657921 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8ca5a093-6885-43b6-9e8f-22671b9a46df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:31.665879 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8ca5a093-6885-43b6-9e8f-22671b9a46df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:31.668063 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8ca5a093-6885-43b6-9e8f-22671b9a46df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:31.669475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8ca5a093-6885-43b6-9e8f-22671b9a46df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.153215 May 23 15:32:31.670052 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 180/357] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:31 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:31.706826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8bfb5d57-805b-4377-95b6-31c60eacec2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:31.707452 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8bfb5d57-805b-4377-95b6-31c60eacec2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:31.714449 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8bfb5d57-805b-4377-95b6-31c60eacec2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:31.714893 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8bfb5d57-805b-4377-95b6-31c60eacec2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:31.715664 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8bfb5d57-805b-4377-95b6-31c60eacec2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:31.716099 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8bfb5d57-805b-4377-95b6-31c60eacec2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:31.844209 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-8bfb5d57-805b-4377-95b6-31c60eacec2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:31.851654 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8bfb5d57-805b-4377-95b6-31c60eacec2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.148686 May 23 15:32:31.852211 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 178/358] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:31 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:31.950051 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f25ff612-11fa-4871-bb6c-317e3a6b362d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:31.950699 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f25ff612-11fa-4871-bb6c-317e3a6b362d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:31.956725 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f25ff612-11fa-4871-bb6c-317e3a6b362d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:31.957219 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f25ff612-11fa-4871-bb6c-317e3a6b362d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:31.957995 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f25ff612-11fa-4871-bb6c-317e3a6b362d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:31.958442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f25ff612-11fa-4871-bb6c-317e3a6b362d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:32.092949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f25ff612-11fa-4871-bb6c-317e3a6b362d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:32.100406 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f25ff612-11fa-4871-bb6c-317e3a6b362d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.154810 May 23 15:32:32.100981 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 181/359] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:31 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:32.693852 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-87720e8e-6a2c-4dda-8b3c-5ba32d8b6623 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:32.694468 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-87720e8e-6a2c-4dda-8b3c-5ba32d8b6623 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:32.700514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-87720e8e-6a2c-4dda-8b3c-5ba32d8b6623 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:32.701268 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-87720e8e-6a2c-4dda-8b3c-5ba32d8b6623 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:32.702031 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-87720e8e-6a2c-4dda-8b3c-5ba32d8b6623 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:32.702472 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-87720e8e-6a2c-4dda-8b3c-5ba32d8b6623 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:32.833928 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-87720e8e-6a2c-4dda-8b3c-5ba32d8b6623 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:32.843058 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-87720e8e-6a2c-4dda-8b3c-5ba32d8b6623 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:32.844569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-87720e8e-6a2c-4dda-8b3c-5ba32d8b6623 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:32.845831 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-87720e8e-6a2c-4dda-8b3c-5ba32d8b6623 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.155805 May 23 15:32:32.846300 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 179/360] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:32 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:32.869425 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-39a4d47c-036a-4e68-8527-8cbb2fd260aa tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:32.870157 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-39a4d47c-036a-4e68-8527-8cbb2fd260aa tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:32.877188 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-39a4d47c-036a-4e68-8527-8cbb2fd260aa tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:32.877643 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-39a4d47c-036a-4e68-8527-8cbb2fd260aa tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:32.878415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-39a4d47c-036a-4e68-8527-8cbb2fd260aa tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:32.878856 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-39a4d47c-036a-4e68-8527-8cbb2fd260aa tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:33.009311 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-39a4d47c-036a-4e68-8527-8cbb2fd260aa tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:33.017354 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-39a4d47c-036a-4e68-8527-8cbb2fd260aa tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.152188 May 23 15:32:33.017930 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 182/361] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:32 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:33.117670 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8a080b6b-feca-4e24-83f1-a654cf5d75a2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:33.118335 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8a080b6b-feca-4e24-83f1-a654cf5d75a2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:33.125075 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8a080b6b-feca-4e24-83f1-a654cf5d75a2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:33.125525 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8a080b6b-feca-4e24-83f1-a654cf5d75a2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:33.126292 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8a080b6b-feca-4e24-83f1-a654cf5d75a2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:33.126727 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8a080b6b-feca-4e24-83f1-a654cf5d75a2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:33.256982 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-8a080b6b-feca-4e24-83f1-a654cf5d75a2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:33.265606 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8a080b6b-feca-4e24-83f1-a654cf5d75a2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.151781 May 23 15:32:33.266262 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 180/362] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:33 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:33.863329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ad1d6bb5-5556-4b10-8ad8-fbcd281dd489 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:33.863938 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ad1d6bb5-5556-4b10-8ad8-fbcd281dd489 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:33.870584 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ad1d6bb5-5556-4b10-8ad8-fbcd281dd489 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:33.871298 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ad1d6bb5-5556-4b10-8ad8-fbcd281dd489 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:33.872199 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ad1d6bb5-5556-4b10-8ad8-fbcd281dd489 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:33.872640 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ad1d6bb5-5556-4b10-8ad8-fbcd281dd489 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:34.007402 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ad1d6bb5-5556-4b10-8ad8-fbcd281dd489 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:34.016054 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ad1d6bb5-5556-4b10-8ad8-fbcd281dd489 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:34.017591 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ad1d6bb5-5556-4b10-8ad8-fbcd281dd489 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:34.018738 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ad1d6bb5-5556-4b10-8ad8-fbcd281dd489 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.159152 May 23 15:32:34.019285 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 183/363] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:33 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:34.034024 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-fee0dee1-a215-41f1-902d-1960bddc829b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:34.034642 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-fee0dee1-a215-41f1-902d-1960bddc829b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:34.040709 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fee0dee1-a215-41f1-902d-1960bddc829b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:34.041186 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fee0dee1-a215-41f1-902d-1960bddc829b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:34.041978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fee0dee1-a215-41f1-902d-1960bddc829b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:34.042504 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fee0dee1-a215-41f1-902d-1960bddc829b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:34.173842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-fee0dee1-a215-41f1-902d-1960bddc829b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:34.181545 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-fee0dee1-a215-41f1-902d-1960bddc829b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.151339 May 23 15:32:34.182212 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 181/364] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:34 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:34.282502 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-afc60c9d-6106-40e7-bb2c-7e0c149df46d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:34.283108 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-afc60c9d-6106-40e7-bb2c-7e0c149df46d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:34.288981 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-afc60c9d-6106-40e7-bb2c-7e0c149df46d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:34.289431 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-afc60c9d-6106-40e7-bb2c-7e0c149df46d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:34.290189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-afc60c9d-6106-40e7-bb2c-7e0c149df46d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:34.290620 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-afc60c9d-6106-40e7-bb2c-7e0c149df46d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:34.429249 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-afc60c9d-6106-40e7-bb2c-7e0c149df46d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:34.437982 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-afc60c9d-6106-40e7-bb2c-7e0c149df46d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.159388 May 23 15:32:34.438553 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 184/365] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:34 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:35.036567 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-eb0bd475-a3f1-4e2a-bc8e-cad7730d3364 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:35.037222 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-eb0bd475-a3f1-4e2a-bc8e-cad7730d3364 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:35.043394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eb0bd475-a3f1-4e2a-bc8e-cad7730d3364 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:35.043871 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eb0bd475-a3f1-4e2a-bc8e-cad7730d3364 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:35.044632 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eb0bd475-a3f1-4e2a-bc8e-cad7730d3364 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:35.045098 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eb0bd475-a3f1-4e2a-bc8e-cad7730d3364 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:35.177731 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-eb0bd475-a3f1-4e2a-bc8e-cad7730d3364 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:35.186577 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-eb0bd475-a3f1-4e2a-bc8e-cad7730d3364 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:35.188086 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-eb0bd475-a3f1-4e2a-bc8e-cad7730d3364 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:35.189289 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-eb0bd475-a3f1-4e2a-bc8e-cad7730d3364 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.156565 May 23 15:32:35.189847 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 182/366] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:35 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:35.199100 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7fe5ce3b-0947-47ca-8622-f6ef34272b44 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:35.199799 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7fe5ce3b-0947-47ca-8622-f6ef34272b44 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:35.206736 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7fe5ce3b-0947-47ca-8622-f6ef34272b44 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:35.207481 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7fe5ce3b-0947-47ca-8622-f6ef34272b44 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:35.208262 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7fe5ce3b-0947-47ca-8622-f6ef34272b44 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:35.208710 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7fe5ce3b-0947-47ca-8622-f6ef34272b44 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:35.335926 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-7fe5ce3b-0947-47ca-8622-f6ef34272b44 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:35.343959 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7fe5ce3b-0947-47ca-8622-f6ef34272b44 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.149104 May 23 15:32:35.344529 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 185/367] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:35 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:35.455785 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-246daa57-214c-4cd8-89bf-75bdd539df0a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:35.456407 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-246daa57-214c-4cd8-89bf-75bdd539df0a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:35.462372 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-246daa57-214c-4cd8-89bf-75bdd539df0a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:35.462828 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-246daa57-214c-4cd8-89bf-75bdd539df0a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:35.464258 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-246daa57-214c-4cd8-89bf-75bdd539df0a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:35.464874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-246daa57-214c-4cd8-89bf-75bdd539df0a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:35.591443 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-246daa57-214c-4cd8-89bf-75bdd539df0a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:35.598804 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-246daa57-214c-4cd8-89bf-75bdd539df0a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.147171 May 23 15:32:35.599358 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 183/368] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:35 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:36.207847 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-cd2fffba-d46e-4cef-b3e7-26991b5feb83 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:36.208646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-cd2fffba-d46e-4cef-b3e7-26991b5feb83 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:36.215673 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cd2fffba-d46e-4cef-b3e7-26991b5feb83 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:36.216116 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cd2fffba-d46e-4cef-b3e7-26991b5feb83 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:36.216895 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cd2fffba-d46e-4cef-b3e7-26991b5feb83 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:36.217329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cd2fffba-d46e-4cef-b3e7-26991b5feb83 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:36.351366 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-cd2fffba-d46e-4cef-b3e7-26991b5feb83 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:36.359413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-cd2fffba-d46e-4cef-b3e7-26991b5feb83 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:36.360844 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b0829817-743a-4a3f-a0d1-50be500d22d9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:36.361380 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-cd2fffba-d46e-4cef-b3e7-26991b5feb83 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:36.361539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b0829817-743a-4a3f-a0d1-50be500d22d9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:36.362166 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-cd2fffba-d46e-4cef-b3e7-26991b5feb83 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.158284 May 23 15:32:36.362728 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 186/369] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:36 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:32:36.367606 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b0829817-743a-4a3f-a0d1-50be500d22d9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:36.368043 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b0829817-743a-4a3f-a0d1-50be500d22d9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:36.368799 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b0829817-743a-4a3f-a0d1-50be500d22d9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:36.369254 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b0829817-743a-4a3f-a0d1-50be500d22d9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:36.498330 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b0829817-743a-4a3f-a0d1-50be500d22d9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:36.505667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b0829817-743a-4a3f-a0d1-50be500d22d9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.148586 May 23 15:32:36.506231 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 184/370] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:36 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:36.615580 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3e19f146-fc5b-4d23-a9c6-8d51b94120d4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:36.616231 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-3e19f146-fc5b-4d23-a9c6-8d51b94120d4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:36.622880 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3e19f146-fc5b-4d23-a9c6-8d51b94120d4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:36.623344 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3e19f146-fc5b-4d23-a9c6-8d51b94120d4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:36.624117 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3e19f146-fc5b-4d23-a9c6-8d51b94120d4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:36.624560 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3e19f146-fc5b-4d23-a9c6-8d51b94120d4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:36.656755 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:36.751006 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3e19f146-fc5b-4d23-a9c6-8d51b94120d4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:36.758365 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-3e19f146-fc5b-4d23-a9c6-8d51b94120d4 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.146640 May 23 15:32:36.758949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 187/371] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:36 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:37.381146 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b3bd14c4-0adb-4613-8998-91547bffe5d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:37.381765 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b3bd14c4-0adb-4613-8998-91547bffe5d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:37.389322 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b3bd14c4-0adb-4613-8998-91547bffe5d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:37.389776 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b3bd14c4-0adb-4613-8998-91547bffe5d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:37.390544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b3bd14c4-0adb-4613-8998-91547bffe5d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:37.390987 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b3bd14c4-0adb-4613-8998-91547bffe5d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:37.523500 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5c3bde63-d7dd-4006-920d-ff45ecaf39d2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:37.523960 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b3bd14c4-0adb-4613-8998-91547bffe5d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:37.524128 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-5c3bde63-d7dd-4006-920d-ff45ecaf39d2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:37.531460 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5c3bde63-d7dd-4006-920d-ff45ecaf39d2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:37.531911 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5c3bde63-d7dd-4006-920d-ff45ecaf39d2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:37.532475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b3bd14c4-0adb-4613-8998-91547bffe5d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:37.532704 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5c3bde63-d7dd-4006-920d-ff45ecaf39d2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:37.533166 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5c3bde63-d7dd-4006-920d-ff45ecaf39d2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:37.534018 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b3bd14c4-0adb-4613-8998-91547bffe5d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:37.535179 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b3bd14c4-0adb-4613-8998-91547bffe5d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.157996 May 23 15:32:37.535745 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 185/372] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:37 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:37.664642 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-5c3bde63-d7dd-4006-920d-ff45ecaf39d2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:37.672391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-5c3bde63-d7dd-4006-920d-ff45ecaf39d2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.152826 May 23 15:32:37.672985 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 188/373] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:37 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:37.775492 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-087f2453-2d74-4a51-88de-4f279ab2a867 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:37.776526 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-087f2453-2d74-4a51-88de-4f279ab2a867 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:37.782692 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-087f2453-2d74-4a51-88de-4f279ab2a867 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:37.783148 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-087f2453-2d74-4a51-88de-4f279ab2a867 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:37.783918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-087f2453-2d74-4a51-88de-4f279ab2a867 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:37.784358 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-087f2453-2d74-4a51-88de-4f279ab2a867 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:37.908663 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-087f2453-2d74-4a51-88de-4f279ab2a867 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:37.916061 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-087f2453-2d74-4a51-88de-4f279ab2a867 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.144542 May 23 15:32:37.916629 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 186/374] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:37 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:38.553271 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a404d9b1-912f-4e38-9ebd-105261cedf0a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:38.553888 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-a404d9b1-912f-4e38-9ebd-105261cedf0a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:38.561503 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a404d9b1-912f-4e38-9ebd-105261cedf0a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:38.561971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a404d9b1-912f-4e38-9ebd-105261cedf0a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:38.562814 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a404d9b1-912f-4e38-9ebd-105261cedf0a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:38.563354 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a404d9b1-912f-4e38-9ebd-105261cedf0a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:38.689433 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a64144c5-2c82-42d5-b431-0495ccc6f697 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:38.690037 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a64144c5-2c82-42d5-b431-0495ccc6f697 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:38.696501 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a64144c5-2c82-42d5-b431-0495ccc6f697 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:38.697056 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a64144c5-2c82-42d5-b431-0495ccc6f697 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:38.697825 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a64144c5-2c82-42d5-b431-0495ccc6f697 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:38.699034 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a64144c5-2c82-42d5-b431-0495ccc6f697 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:38.706437 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a404d9b1-912f-4e38-9ebd-105261cedf0a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:38.714805 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a404d9b1-912f-4e38-9ebd-105261cedf0a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:38.716325 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a404d9b1-912f-4e38-9ebd-105261cedf0a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:38.717552 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a404d9b1-912f-4e38-9ebd-105261cedf0a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.168155 May 23 15:32:38.718322 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 189/375] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:38 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:38.836617 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a64144c5-2c82-42d5-b431-0495ccc6f697 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:38.845984 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a64144c5-2c82-42d5-b431-0495ccc6f697 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.160311 May 23 15:32:38.859160 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 187/376] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:38 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:38.934157 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c920ec7c-546c-410b-9d8c-d65373a51e65 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:38.934987 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c920ec7c-546c-410b-9d8c-d65373a51e65 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:38.941446 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c920ec7c-546c-410b-9d8c-d65373a51e65 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:38.942192 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c920ec7c-546c-410b-9d8c-d65373a51e65 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:38.942965 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c920ec7c-546c-410b-9d8c-d65373a51e65 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:38.943435 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c920ec7c-546c-410b-9d8c-d65373a51e65 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:39.169229 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c920ec7c-546c-410b-9d8c-d65373a51e65 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:39.176779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c920ec7c-546c-410b-9d8c-d65373a51e65 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.247462 May 23 15:32:39.177370 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 190/377] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:38 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:39.736355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d7361051-9a0e-4154-ba4e-5cb1b022c9ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:39.737067 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d7361051-9a0e-4154-ba4e-5cb1b022c9ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:39.743442 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d7361051-9a0e-4154-ba4e-5cb1b022c9ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:39.743888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d7361051-9a0e-4154-ba4e-5cb1b022c9ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:39.744645 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d7361051-9a0e-4154-ba4e-5cb1b022c9ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:39.745887 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d7361051-9a0e-4154-ba4e-5cb1b022c9ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:39.874376 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f64379a9-f36d-426c-bb5b-b3c9394baaa4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:39.875076 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f64379a9-f36d-426c-bb5b-b3c9394baaa4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:39.884038 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d7361051-9a0e-4154-ba4e-5cb1b022c9ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:39.886631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=100 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:39.893955 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f64379a9-f36d-426c-bb5b-b3c9394baaa4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:39.894419 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f64379a9-f36d-426c-bb5b-b3c9394baaa4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:39.895222 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f64379a9-f36d-426c-bb5b-b3c9394baaa4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:39.895694 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f64379a9-f36d-426c-bb5b-b3c9394baaa4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:39.896339 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d7361051-9a0e-4154-ba4e-5cb1b022c9ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:39.898052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d7361051-9a0e-4154-ba4e-5cb1b022c9ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:39.899318 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d7361051-9a0e-4154-ba4e-5cb1b022c9ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.166867 May 23 15:32:39.899957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 188/378] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:39 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:40.049138 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f64379a9-f36d-426c-bb5b-b3c9394baaa4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:40.056683 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f64379a9-f36d-426c-bb5b-b3c9394baaa4 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.197027 May 23 15:32:40.057814 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 191/379] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:39 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:40.194185 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-14d33d2e-f3db-4083-b0fb-c7c5cfafb6ef tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:40.194903 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-14d33d2e-f3db-4083-b0fb-c7c5cfafb6ef tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:40.202816 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-14d33d2e-f3db-4083-b0fb-c7c5cfafb6ef tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:40.203353 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-14d33d2e-f3db-4083-b0fb-c7c5cfafb6ef tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:40.205189 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-14d33d2e-f3db-4083-b0fb-c7c5cfafb6ef tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:40.205980 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-14d33d2e-f3db-4083-b0fb-c7c5cfafb6ef tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:40.340305 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-14d33d2e-f3db-4083-b0fb-c7c5cfafb6ef tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:40.348016 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-14d33d2e-f3db-4083-b0fb-c7c5cfafb6ef tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.158187 May 23 15:32:40.348610 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 189/380] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:40 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:40.918705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-69c46cec-9686-4989-851e-fd4c4567b052 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:40.919234 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-69c46cec-9686-4989-851e-fd4c4567b052 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:40.925685 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-69c46cec-9686-4989-851e-fd4c4567b052 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:40.926131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-69c46cec-9686-4989-851e-fd4c4567b052 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:40.926886 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-69c46cec-9686-4989-851e-fd4c4567b052 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:40.927321 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-69c46cec-9686-4989-851e-fd4c4567b052 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:41.057151 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-69c46cec-9686-4989-851e-fd4c4567b052 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:41.065211 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-69c46cec-9686-4989-851e-fd4c4567b052 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:41.066706 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-69c46cec-9686-4989-851e-fd4c4567b052 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:41.067853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-69c46cec-9686-4989-851e-fd4c4567b052 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.153739 May 23 15:32:41.068407 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 192/381] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:40 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:32:41.074321 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-0fdd1da0-bbb6-48c0-a5e7-a2c7102b0f7d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:41.075467 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-0fdd1da0-bbb6-48c0-a5e7-a2c7102b0f7d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:41.081856 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fdd1da0-bbb6-48c0-a5e7-a2c7102b0f7d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:41.082305 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fdd1da0-bbb6-48c0-a5e7-a2c7102b0f7d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:41.083072 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fdd1da0-bbb6-48c0-a5e7-a2c7102b0f7d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:41.083509 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fdd1da0-bbb6-48c0-a5e7-a2c7102b0f7d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:41.207562 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0fdd1da0-bbb6-48c0-a5e7-a2c7102b0f7d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:41.214981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-0fdd1da0-bbb6-48c0-a5e7-a2c7102b0f7d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.144955 May 23 15:32:41.215547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 190/382] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:41 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:41.365761 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-686e4833-c2af-42c1-9770-522c5fc26432 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:41.366373 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-686e4833-c2af-42c1-9770-522c5fc26432 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:41.372600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-686e4833-c2af-42c1-9770-522c5fc26432 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:41.373086 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-686e4833-c2af-42c1-9770-522c5fc26432 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:41.373846 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-686e4833-c2af-42c1-9770-522c5fc26432 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:41.374281 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-686e4833-c2af-42c1-9770-522c5fc26432 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:41.514981 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-686e4833-c2af-42c1-9770-522c5fc26432 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:41.522748 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-686e4833-c2af-42c1-9770-522c5fc26432 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.160731 May 23 15:32:41.523584 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 193/383] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:41 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:42.086392 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4e1f0b30-818f-41b5-bf52-a337e2dafad9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:42.087014 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4e1f0b30-818f-41b5-bf52-a337e2dafad9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:42.090016 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=98 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:42.095113 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4e1f0b30-818f-41b5-bf52-a337e2dafad9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:42.095557 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4e1f0b30-818f-41b5-bf52-a337e2dafad9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:42.096308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4e1f0b30-818f-41b5-bf52-a337e2dafad9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:42.096770 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4e1f0b30-818f-41b5-bf52-a337e2dafad9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:42.226690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4e1f0b30-818f-41b5-bf52-a337e2dafad9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:42.231549 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-fbfba25c-ce89-49be-ba8e-1ef2ab53ce12 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:42.232575 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-fbfba25c-ce89-49be-ba8e-1ef2ab53ce12 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:42.235126 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4e1f0b30-818f-41b5-bf52-a337e2dafad9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:42.236615 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4e1f0b30-818f-41b5-bf52-a337e2dafad9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:42.237795 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4e1f0b30-818f-41b5-bf52-a337e2dafad9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1740 microversion: 2.20 time: 0.155215 May 23 15:32:42.238349 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 191/384] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:42 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:42.241482 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fbfba25c-ce89-49be-ba8e-1ef2ab53ce12 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:42.241890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fbfba25c-ce89-49be-ba8e-1ef2ab53ce12 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:42.242671 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fbfba25c-ce89-49be-ba8e-1ef2ab53ce12 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:42.243118 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fbfba25c-ce89-49be-ba8e-1ef2ab53ce12 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:42.373446 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-fbfba25c-ce89-49be-ba8e-1ef2ab53ce12 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:42.375629 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=100 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:42.382290 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-fbfba25c-ce89-49be-ba8e-1ef2ab53ce12 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.154692 May 23 15:32:42.382857 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 194/385] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:42 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:42.541620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b83a0bad-76fe-492e-b414-be2cc57f5d37 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:42.542835 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b83a0bad-76fe-492e-b414-be2cc57f5d37 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:42.549896 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b83a0bad-76fe-492e-b414-be2cc57f5d37 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:42.550583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b83a0bad-76fe-492e-b414-be2cc57f5d37 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:42.551536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b83a0bad-76fe-492e-b414-be2cc57f5d37 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:42.551981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b83a0bad-76fe-492e-b414-be2cc57f5d37 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:42.687895 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b83a0bad-76fe-492e-b414-be2cc57f5d37 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:42.697176 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b83a0bad-76fe-492e-b414-be2cc57f5d37 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.160563 May 23 15:32:42.698134 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 192/386] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:42 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:42.704325 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-8f4543c3-3f10-4ac4-a575-af51bceae5dd req-9ee88264-1750-4528-ba09-1c066755a829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9038c8-1395-4d48-b10b-2fe7310c4c76", "name": "network-vif-unplugged", "status": "completed", "tag": "920328ed-01fa-4ed4-b496-7b1fea54b54c"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:32:42.713489 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-8f4543c3-3f10-4ac4-a575-af51bceae5dd req-9ee88264-1750-4528-ba09-1c066755a829 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:42.713978 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-8f4543c3-3f10-4ac4-a575-af51bceae5dd req-9ee88264-1750-4528-ba09-1c066755a829 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:42.726066 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-8f4543c3-3f10-4ac4-a575-af51bceae5dd req-9ee88264-1750-4528-ba09-1c066755a829 service nova] Creating event network-vif-unplugged:920328ed-01fa-4ed4-b496-7b1fea54b54c for instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 on hv-cinder-84112 May 23 15:32:42.732150 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-8f4543c3-3f10-4ac4-a575-af51bceae5dd req-9ee88264-1750-4528-ba09-1c066755a829 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034018 May 23 15:32:42.733482 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 195/387] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:32:43.256395 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-69e05cd1-97e6-4ec7-b2a8-069b890f532d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:43.257037 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-69e05cd1-97e6-4ec7-b2a8-069b890f532d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:43.263682 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-69e05cd1-97e6-4ec7-b2a8-069b890f532d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:43.264136 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-69e05cd1-97e6-4ec7-b2a8-069b890f532d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:43.265509 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-69e05cd1-97e6-4ec7-b2a8-069b890f532d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:43.265956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-69e05cd1-97e6-4ec7-b2a8-069b890f532d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:43.405135 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-17a403c4-bba8-439e-b7ba-0653512167f7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:43.405135 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-17a403c4-bba8-439e-b7ba-0653512167f7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:43.407888 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-17a403c4-bba8-439e-b7ba-0653512167f7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:43.408345 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-17a403c4-bba8-439e-b7ba-0653512167f7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:43.409152 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-17a403c4-bba8-439e-b7ba-0653512167f7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:43.409597 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-17a403c4-bba8-439e-b7ba-0653512167f7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:43.416367 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-69e05cd1-97e6-4ec7-b2a8-069b890f532d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:43.427939 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-69e05cd1-97e6-4ec7-b2a8-069b890f532d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:43.430788 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-69e05cd1-97e6-4ec7-b2a8-069b890f532d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:43.444922 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-69e05cd1-97e6-4ec7-b2a8-069b890f532d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1722 microversion: 2.20 time: 0.182104 May 23 15:32:43.446023 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 193/388] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:43 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:43.531229 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8eda9105-8ee3-4c5d-a5e5-b26bad19d66f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:32:43.537588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8eda9105-8ee3-4c5d-a5e5-b26bad19d66f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:43.538046 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8eda9105-8ee3-4c5d-a5e5-b26bad19d66f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:43.557678 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-17a403c4-bba8-439e-b7ba-0653512167f7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:43.565349 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-17a403c4-bba8-439e-b7ba-0653512167f7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.169577 May 23 15:32:43.565854 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 196/389] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:43 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:43.574549 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-14a8a8cd-c399-48ae-acb1-08cf87a2ff03 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b2744bd-ab28-4f02-a5a0-9a762151d575"}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:32:43.575635 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-14a8a8cd-c399-48ae-acb1-08cf87a2ff03 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:43.581440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-14a8a8cd-c399-48ae-acb1-08cf87a2ff03 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:43.581884 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-14a8a8cd-c399-48ae-acb1-08cf87a2ff03 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:43.582668 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-14a8a8cd-c399-48ae-acb1-08cf87a2ff03 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:43.583103 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-14a8a8cd-c399-48ae-acb1-08cf87a2ff03 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:43.605712 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8eda9105-8ee3-4c5d-a5e5-b26bad19d66f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Going to try to stop instance {{(pid=117974) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 15:32:43.652431 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8eda9105-8ee3-4c5d-a5e5-b26bad19d66f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "POST /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/action" status: 202 len: 0 microversion: 2.1 time: 0.126303 May 23 15:32:43.653063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 194/390] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 15:32:43 2022] POST /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:32:43.661769 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d2e35982-034e-486b-afbe-3dbb15dc9acb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:43.662473 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d2e35982-034e-486b-afbe-3dbb15dc9acb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:43.668849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d2e35982-034e-486b-afbe-3dbb15dc9acb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:43.669339 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d2e35982-034e-486b-afbe-3dbb15dc9acb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:43.670100 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d2e35982-034e-486b-afbe-3dbb15dc9acb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:43.670536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d2e35982-034e-486b-afbe-3dbb15dc9acb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:43.803922 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d2e35982-034e-486b-afbe-3dbb15dc9acb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:43.812624 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d2e35982-034e-486b-afbe-3dbb15dc9acb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1721 microversion: 2.1 time: 0.155025 May 23 15:32:43.820517 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 195/391] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:43 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:43.820517 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f172b1a1-38f4-4abf-98d9-85dc01c24c64 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:43.820517 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f172b1a1-38f4-4abf-98d9-85dc01c24c64 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:43.825273 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f172b1a1-38f4-4abf-98d9-85dc01c24c64 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:43.825651 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f172b1a1-38f4-4abf-98d9-85dc01c24c64 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:43.826417 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f172b1a1-38f4-4abf-98d9-85dc01c24c64 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:43.826859 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f172b1a1-38f4-4abf-98d9-85dc01c24c64 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:43.970449 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-f172b1a1-38f4-4abf-98d9-85dc01c24c64 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:43.978060 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f172b1a1-38f4-4abf-98d9-85dc01c24c64 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.163496 May 23 15:32:43.978618 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 196/392] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:43 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:44.465113 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-9d724c6f-da50-4cee-a6e2-eae01885ec72 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:44.467304 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-9d724c6f-da50-4cee-a6e2-eae01885ec72 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:44.472340 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9d724c6f-da50-4cee-a6e2-eae01885ec72 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:44.472788 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9d724c6f-da50-4cee-a6e2-eae01885ec72 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:44.473611 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9d724c6f-da50-4cee-a6e2-eae01885ec72 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:44.474045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9d724c6f-da50-4cee-a6e2-eae01885ec72 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:44.602797 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9d724c6f-da50-4cee-a6e2-eae01885ec72 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:44.610864 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9d724c6f-da50-4cee-a6e2-eae01885ec72 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:44.612345 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9d724c6f-da50-4cee-a6e2-eae01885ec72 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:44.613535 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-9d724c6f-da50-4cee-a6e2-eae01885ec72 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1722 microversion: 2.20 time: 0.153960 May 23 15:32:44.614094 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 197/393] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:44 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:32:44.618502 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-add645c6-3148-45fb-b944-9a7a4d92b2a2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:44.619103 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-add645c6-3148-45fb-b944-9a7a4d92b2a2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:44.625597 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-add645c6-3148-45fb-b944-9a7a4d92b2a2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:44.626046 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-add645c6-3148-45fb-b944-9a7a4d92b2a2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:44.626803 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-add645c6-3148-45fb-b944-9a7a4d92b2a2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:44.627238 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-add645c6-3148-45fb-b944-9a7a4d92b2a2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:44.758711 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-add645c6-3148-45fb-b944-9a7a4d92b2a2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:44.767147 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-add645c6-3148-45fb-b944-9a7a4d92b2a2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.152090 May 23 15:32:44.767719 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 198/394] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:44 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:44.830355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4634dbef-cb7b-46f4-a1a1-679cbdf54ebc tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:44.830973 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4634dbef-cb7b-46f4-a1a1-679cbdf54ebc tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:44.837311 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4634dbef-cb7b-46f4-a1a1-679cbdf54ebc tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:44.837759 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4634dbef-cb7b-46f4-a1a1-679cbdf54ebc tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:44.838511 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4634dbef-cb7b-46f4-a1a1-679cbdf54ebc tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:44.838951 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4634dbef-cb7b-46f4-a1a1-679cbdf54ebc tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:44.969426 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4634dbef-cb7b-46f4-a1a1-679cbdf54ebc tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:44.977846 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4634dbef-cb7b-46f4-a1a1-679cbdf54ebc tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1721 microversion: 2.1 time: 0.151247 May 23 15:32:44.978408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 199/395] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:44 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:44.994283 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e4a56cd3-8c52-4504-96a8-0f522cef13c9 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:44.995460 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e4a56cd3-8c52-4504-96a8-0f522cef13c9 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:45.001466 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e4a56cd3-8c52-4504-96a8-0f522cef13c9 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:45.001916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e4a56cd3-8c52-4504-96a8-0f522cef13c9 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:45.002693 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e4a56cd3-8c52-4504-96a8-0f522cef13c9 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:45.003135 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e4a56cd3-8c52-4504-96a8-0f522cef13c9 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:45.145278 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e4a56cd3-8c52-4504-96a8-0f522cef13c9 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:45.152803 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e4a56cd3-8c52-4504-96a8-0f522cef13c9 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.162188 May 23 15:32:45.153398 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 200/396] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:44 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:45.631784 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e1f3e44f-a44b-4c73-9d01-4b12a1df54cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:45.632402 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e1f3e44f-a44b-4c73-9d01-4b12a1df54cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:45.639320 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e1f3e44f-a44b-4c73-9d01-4b12a1df54cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:45.639807 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e1f3e44f-a44b-4c73-9d01-4b12a1df54cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:45.640583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e1f3e44f-a44b-4c73-9d01-4b12a1df54cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:45.641081 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e1f3e44f-a44b-4c73-9d01-4b12a1df54cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:45.771008 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e1f3e44f-a44b-4c73-9d01-4b12a1df54cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:45.787267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e1f3e44f-a44b-4c73-9d01-4b12a1df54cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:45.789466 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e1f3e44f-a44b-4c73-9d01-4b12a1df54cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:45.790893 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e1f3e44f-a44b-4c73-9d01-4b12a1df54cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1722 microversion: 2.20 time: 0.163017 May 23 15:32:45.797669 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 201/397] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:45 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:32:45.804431 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-11ac842b-16c8-4939-b302-584f00351a39 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:45.805155 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-11ac842b-16c8-4939-b302-584f00351a39 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:45.812442 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-11ac842b-16c8-4939-b302-584f00351a39 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:45.812912 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-11ac842b-16c8-4939-b302-584f00351a39 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:45.813680 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-11ac842b-16c8-4939-b302-584f00351a39 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:45.814117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-11ac842b-16c8-4939-b302-584f00351a39 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:45.959652 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-11ac842b-16c8-4939-b302-584f00351a39 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:45.968423 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-11ac842b-16c8-4939-b302-584f00351a39 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.168705 May 23 15:32:45.969027 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 202/398] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:45 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:45.997335 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ffc5f51b-f769-48b6-a186-9f00f0511f96 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:45.997949 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ffc5f51b-f769-48b6-a186-9f00f0511f96 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:46.005243 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ffc5f51b-f769-48b6-a186-9f00f0511f96 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:46.005874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ffc5f51b-f769-48b6-a186-9f00f0511f96 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:46.006711 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ffc5f51b-f769-48b6-a186-9f00f0511f96 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:46.007159 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ffc5f51b-f769-48b6-a186-9f00f0511f96 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:46.049744 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-14a8a8cd-c399-48ae-acb1-08cf87a2ff03 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "POST /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.479352 May 23 15:32:46.050813 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 197/399] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 15:32:43 2022] POST /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/os-volume_attachments => generated 194 bytes in 2484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:32:46.158365 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ffc5f51b-f769-48b6-a186-9f00f0511f96 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:46.170167 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ffc5f51b-f769-48b6-a186-9f00f0511f96 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1721 microversion: 2.1 time: 0.178094 May 23 15:32:46.171020 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 203/400] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:45 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:46.171608 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d6f25408-66e1-4845-85ca-b8142de15dd8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:46.172445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d6f25408-66e1-4845-85ca-b8142de15dd8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:46.179187 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d6f25408-66e1-4845-85ca-b8142de15dd8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:46.179645 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d6f25408-66e1-4845-85ca-b8142de15dd8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:46.180426 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d6f25408-66e1-4845-85ca-b8142de15dd8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:46.181042 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d6f25408-66e1-4845-85ca-b8142de15dd8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:46.339749 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d6f25408-66e1-4845-85ca-b8142de15dd8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:46.347222 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d6f25408-66e1-4845-85ca-b8142de15dd8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1511 microversion: 2.1 time: 0.181173 May 23 15:32:46.347795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 198/401] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:46 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:46.810828 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e12dfee4-5569-4f49-9b88-31a7e19941d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:46.811451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e12dfee4-5569-4f49-9b88-31a7e19941d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:46.819087 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e12dfee4-5569-4f49-9b88-31a7e19941d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:46.819594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e12dfee4-5569-4f49-9b88-31a7e19941d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:46.820637 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e12dfee4-5569-4f49-9b88-31a7e19941d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:46.821150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e12dfee4-5569-4f49-9b88-31a7e19941d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:46.846755 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:46.986968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-6e01d18f-5da1-4775-991b-0c442e46a5a7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:46.987878 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-6e01d18f-5da1-4775-991b-0c442e46a5a7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:46.994399 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6e01d18f-5da1-4775-991b-0c442e46a5a7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:46.994913 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6e01d18f-5da1-4775-991b-0c442e46a5a7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:46.995664 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6e01d18f-5da1-4775-991b-0c442e46a5a7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:46.998432 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6e01d18f-5da1-4775-991b-0c442e46a5a7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:47.034027 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e12dfee4-5569-4f49-9b88-31a7e19941d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:47.043902 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e12dfee4-5569-4f49-9b88-31a7e19941d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:47.046663 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e12dfee4-5569-4f49-9b88-31a7e19941d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:47.048706 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e12dfee4-5569-4f49-9b88-31a7e19941d3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1722 microversion: 2.20 time: 0.242723 May 23 15:32:47.059914 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 204/402] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:46 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:47.187907 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d0fc3c36-8c0f-4965-aeed-7d7451314fa8 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:47.188720 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d0fc3c36-8c0f-4965-aeed-7d7451314fa8 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:47.195114 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d0fc3c36-8c0f-4965-aeed-7d7451314fa8 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:47.195566 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d0fc3c36-8c0f-4965-aeed-7d7451314fa8 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:47.196471 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d0fc3c36-8c0f-4965-aeed-7d7451314fa8 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:47.197186 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d0fc3c36-8c0f-4965-aeed-7d7451314fa8 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:47.288293 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-6e01d18f-5da1-4775-991b-0c442e46a5a7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:47.299399 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-6e01d18f-5da1-4775-991b-0c442e46a5a7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.317225 May 23 15:32:47.299992 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 199/403] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:46 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:47.364651 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8ae91232-fdd8-49dd-9609-63ab11fe57cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:47.365353 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8ae91232-fdd8-49dd-9609-63ab11fe57cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:47.376624 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8ae91232-fdd8-49dd-9609-63ab11fe57cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:47.378020 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8ae91232-fdd8-49dd-9609-63ab11fe57cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:47.380788 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8ae91232-fdd8-49dd-9609-63ab11fe57cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:47.381497 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8ae91232-fdd8-49dd-9609-63ab11fe57cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:47.656339 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d0fc3c36-8c0f-4965-aeed-7d7451314fa8 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:47.664617 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d0fc3c36-8c0f-4965-aeed-7d7451314fa8 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1721 microversion: 2.1 time: 0.480692 May 23 15:32:47.665216 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 205/404] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:47 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1721 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:47.877721 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8ae91232-fdd8-49dd-9609-63ab11fe57cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:47.886552 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8ae91232-fdd8-49dd-9609-63ab11fe57cc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1517 microversion: 2.1 time: 0.525560 May 23 15:32:47.887168 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 200/405] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:47 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1517 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:48.073973 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3b2044ab-4a92-453e-b14b-7a769d2660bd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:48.074665 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3b2044ab-4a92-453e-b14b-7a769d2660bd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:48.082255 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3b2044ab-4a92-453e-b14b-7a769d2660bd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:48.082695 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3b2044ab-4a92-453e-b14b-7a769d2660bd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:48.083468 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3b2044ab-4a92-453e-b14b-7a769d2660bd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:48.084094 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3b2044ab-4a92-453e-b14b-7a769d2660bd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:48.238213 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3b2044ab-4a92-453e-b14b-7a769d2660bd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:48.248572 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3b2044ab-4a92-453e-b14b-7a769d2660bd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:48.250159 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3b2044ab-4a92-453e-b14b-7a769d2660bd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:48.251427 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3b2044ab-4a92-453e-b14b-7a769d2660bd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1722 microversion: 2.20 time: 0.182045 May 23 15:32:48.251970 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 206/406] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:48 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:48.316838 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-91eec527-5a96-4ace-9908-8feb760e4a5d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:48.317541 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-91eec527-5a96-4ace-9908-8feb760e4a5d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:48.324160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-91eec527-5a96-4ace-9908-8feb760e4a5d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:48.324791 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-91eec527-5a96-4ace-9908-8feb760e4a5d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:48.325759 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-91eec527-5a96-4ace-9908-8feb760e4a5d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:48.326355 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-91eec527-5a96-4ace-9908-8feb760e4a5d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:48.467895 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-91eec527-5a96-4ace-9908-8feb760e4a5d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:48.478539 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-91eec527-5a96-4ace-9908-8feb760e4a5d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.165405 May 23 15:32:48.479130 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 201/407] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:48 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:48.686014 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-32671c38-bfa6-4f74-90a3-3931fb9a085a tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:48.689020 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-32671c38-bfa6-4f74-90a3-3931fb9a085a tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:48.698454 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-32671c38-bfa6-4f74-90a3-3931fb9a085a tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:48.699637 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-32671c38-bfa6-4f74-90a3-3931fb9a085a tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:48.701108 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-32671c38-bfa6-4f74-90a3-3931fb9a085a tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:48.702041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-32671c38-bfa6-4f74-90a3-3931fb9a085a tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:48.849234 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-8573beb8-a224-4f4d-9f38-05c101ff4388 req-7b564411-ee5f-4fae-9000-267215a76c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0f4046-cea9-4426-9970-4ff8f307a3c0", "name": "network-vif-plugged", "status": "completed", "tag": "5ecea450-0a05-473a-b7b2-1cd3cef1fd28"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:32:48.861644 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-8573beb8-a224-4f4d-9f38-05c101ff4388 req-7b564411-ee5f-4fae-9000-267215a76c63 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:48.862104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-8573beb8-a224-4f4d-9f38-05c101ff4388 req-7b564411-ee5f-4fae-9000-267215a76c63 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:48.887567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-8573beb8-a224-4f4d-9f38-05c101ff4388 req-7b564411-ee5f-4fae-9000-267215a76c63 service nova] Creating event network-vif-plugged:5ecea450-0a05-473a-b7b2-1cd3cef1fd28 for instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 on hv-cinder-84112 May 23 15:32:48.891302 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-32671c38-bfa6-4f74-90a3-3931fb9a085a tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:48.894807 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-8573beb8-a224-4f4d-9f38-05c101ff4388 req-7b564411-ee5f-4fae-9000-267215a76c63 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048971 May 23 15:32:48.896303 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 202/408] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:32:48.902907 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-32671c38-bfa6-4f74-90a3-3931fb9a085a tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1721 microversion: 2.1 time: 0.224539 May 23 15:32:48.904222 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 207/409] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:48 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:49.273766 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d11db26c-8237-4531-8ea7-28856a1a70c9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:49.275235 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d11db26c-8237-4531-8ea7-28856a1a70c9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:49.301178 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d11db26c-8237-4531-8ea7-28856a1a70c9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:49.303850 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d11db26c-8237-4531-8ea7-28856a1a70c9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:49.305453 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d11db26c-8237-4531-8ea7-28856a1a70c9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:49.308265 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d11db26c-8237-4531-8ea7-28856a1a70c9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:49.382305 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-6613b1f5-6414-43bb-b1d9-5e20d92d8fa0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Action: 'create', calling method: .version_select at 0x7f0d7a408280>, body: {"keypair": {"name": "tempest-keypair-74447676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTWnyQZXYZaKXCuUrKHS9ri3yQcbuAlRp8RR5vWeber/Pj8II2mSewl4ZFo+au4Mp6IsXVn5Q3O0gttgyrTvz0Q4wQZM4e3WLa6u2EbQhwEAwAG0wi2hukx74h7hQqWWg=="}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:32:49.428233 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-6613b1f5-6414-43bb-b1d9-5e20d92d8fa0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Getting quotas for project 0712b807a4584f7b8f019ceb65ff1e14. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:32:49.436833 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-6613b1f5-6414-43bb-b1d9-5e20d92d8fa0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Getting quotas for user 5074b9fa045543b9a62bf751e736d0df and project 0712b807a4584f7b8f019ceb65ff1e14. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:32:49.470544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-6613b1f5-6414-43bb-b1d9-5e20d92d8fa0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.092786 May 23 15:32:49.472915 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 208/410] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 15:32:49 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:32:49.499176 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a9809e9f-dfbe-47bc-8ac9-f02cf4a69cf7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:49.500728 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a9809e9f-dfbe-47bc-8ac9-f02cf4a69cf7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:49.511932 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a9809e9f-dfbe-47bc-8ac9-f02cf4a69cf7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:49.513310 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a9809e9f-dfbe-47bc-8ac9-f02cf4a69cf7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:49.515056 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a9809e9f-dfbe-47bc-8ac9-f02cf4a69cf7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:49.515506 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a9809e9f-dfbe-47bc-8ac9-f02cf4a69cf7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:49.574047 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d11db26c-8237-4531-8ea7-28856a1a70c9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:49.583678 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d11db26c-8237-4531-8ea7-28856a1a70c9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:49.594265 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d11db26c-8237-4531-8ea7-28856a1a70c9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:49.595653 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d11db26c-8237-4531-8ea7-28856a1a70c9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1722 microversion: 2.20 time: 0.327851 May 23 15:32:49.596240 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 203/411] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:49 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1722 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:49.784449 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a9809e9f-dfbe-47bc-8ac9-f02cf4a69cf7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:49.799907 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a9809e9f-dfbe-47bc-8ac9-f02cf4a69cf7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.307871 May 23 15:32:49.807962 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 209/412] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:49 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:49.920364 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d100588a-6dd1-4767-b722-a08726368b03 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:49.921438 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d100588a-6dd1-4767-b722-a08726368b03 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:49.929454 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d100588a-6dd1-4767-b722-a08726368b03 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:49.930373 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d100588a-6dd1-4767-b722-a08726368b03 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:49.930706 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d100588a-6dd1-4767-b722-a08726368b03 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:49.931152 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d100588a-6dd1-4767-b722-a08726368b03 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:50.115112 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d100588a-6dd1-4767-b722-a08726368b03 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:50.127676 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d100588a-6dd1-4767-b722-a08726368b03 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1721 microversion: 2.1 time: 0.211119 May 23 15:32:50.140075 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 204/413] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:49 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:50.614062 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-402c6a89-709f-4da9-bf84-4a397f47bd7d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:50.614680 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-402c6a89-709f-4da9-bf84-4a397f47bd7d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:50.623164 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-402c6a89-709f-4da9-bf84-4a397f47bd7d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:50.623951 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-402c6a89-709f-4da9-bf84-4a397f47bd7d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:50.625783 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-402c6a89-709f-4da9-bf84-4a397f47bd7d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:50.627307 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-402c6a89-709f-4da9-bf84-4a397f47bd7d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:50.821377 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-402c6a89-709f-4da9-bf84-4a397f47bd7d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:50.823452 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ddee6eb8-0a66-4ee5-ad01-8795a3d8390f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:50.824262 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ddee6eb8-0a66-4ee5-ad01-8795a3d8390f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:50.830733 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ddee6eb8-0a66-4ee5-ad01-8795a3d8390f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:50.830914 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-402c6a89-709f-4da9-bf84-4a397f47bd7d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:50.831184 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ddee6eb8-0a66-4ee5-ad01-8795a3d8390f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:50.832151 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ddee6eb8-0a66-4ee5-ad01-8795a3d8390f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:50.832413 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-402c6a89-709f-4da9-bf84-4a397f47bd7d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:50.832594 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ddee6eb8-0a66-4ee5-ad01-8795a3d8390f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:50.833618 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-402c6a89-709f-4da9-bf84-4a397f47bd7d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1725 microversion: 2.20 time: 0.223949 May 23 15:32:50.834395 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 210/414] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:50 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:32:50.859180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a7b8f65d-ea02-4505-b490-d380966dd6a4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af0693b7-13da-44fe-b90a-e073a95efad2"}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:32:50.860284 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a7b8f65d-ea02-4505-b490-d380966dd6a4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:50.887267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a7b8f65d-ea02-4505-b490-d380966dd6a4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:50.888207 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a7b8f65d-ea02-4505-b490-d380966dd6a4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:50.889489 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a7b8f65d-ea02-4505-b490-d380966dd6a4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:50.890474 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a7b8f65d-ea02-4505-b490-d380966dd6a4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:51.134374 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ddee6eb8-0a66-4ee5-ad01-8795a3d8390f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:51.144003 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ddee6eb8-0a66-4ee5-ad01-8795a3d8390f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.324122 May 23 15:32:51.145004 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 205/415] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:50 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:51.153808 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-62d648c1-2242-45f6-a1b8-ae7026a41771 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:51.154496 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-62d648c1-2242-45f6-a1b8-ae7026a41771 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:51.160724 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-62d648c1-2242-45f6-a1b8-ae7026a41771 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:51.161213 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-62d648c1-2242-45f6-a1b8-ae7026a41771 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:51.162222 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-62d648c1-2242-45f6-a1b8-ae7026a41771 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:51.163258 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-62d648c1-2242-45f6-a1b8-ae7026a41771 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:51.253212 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a7b8f65d-ea02-4505-b490-d380966dd6a4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "POST /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.395096 May 23 15:32:51.254411 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 211/416] 10.222.0.30 () {62 vars in 1363 bytes} [Mon May 23 15:32:50 2022] POST /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-volume_attachments => generated 188 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:32:51.314860 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-62d648c1-2242-45f6-a1b8-ae7026a41771 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:51.328357 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-62d648c1-2242-45f6-a1b8-ae7026a41771 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1721 microversion: 2.1 time: 0.181928 May 23 15:32:51.329482 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 206/417] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:51 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:51.386404 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-7e638131-45c7-4763-8d44-9f3abbdd7dcd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:32:51.387270 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-7e638131-45c7-4763-8d44-9f3abbdd7dcd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:51.398222 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7e638131-45c7-4763-8d44-9f3abbdd7dcd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:51.398675 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7e638131-45c7-4763-8d44-9f3abbdd7dcd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:51.399456 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7e638131-45c7-4763-8d44-9f3abbdd7dcd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:51.399893 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7e638131-45c7-4763-8d44-9f3abbdd7dcd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:51.479868 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-491ec31b-2ab5-47ac-bf49-76fbca743872 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1439987545", "imageRef": "807d39e3-2293-48ca-b2cd-675f7c931014", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d1e2450-f071-48af-a078-8358b70cb4cd"}], "security_groups": [{"name": "tempest-securitygroup--1106571793"}], "key_name": "tempest-keypair-74447676", "user_data": "}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:32:51.508194 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7e638131-45c7-4763-8d44-9f3abbdd7dcd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [941b5830-4cba-418c-bb33-71cbe1300b9e] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 23 15:32:51.588198 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.network.neutron [None req-491ec31b-2ab5-47ac-bf49-76fbca743872 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] validate_networks() for [('0d1e2450-f071-48af-a078-8358b70cb4cd', None, None, None, None, None)] {{(pid=117973) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:32:52.016814 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-491ec31b-2ab5-47ac-bf49-76fbca743872 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Flavor limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:32:52.017407 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-491ec31b-2ab5-47ac-bf49-76fbca743872 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Image limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:32:52.017743 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-491ec31b-2ab5-47ac-bf49-76fbca743872 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Flavor pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:32:52.018154 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-491ec31b-2ab5-47ac-bf49-76fbca743872 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Image pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:32:52.018570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-491ec31b-2ab5-47ac-bf49-76fbca743872 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:32:52.028288 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-491ec31b-2ab5-47ac-bf49-76fbca743872 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:52.028750 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-491ec31b-2ab5-47ac-bf49-76fbca743872 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:52.029572 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-491ec31b-2ab5-47ac-bf49-76fbca743872 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:52.030001 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-491ec31b-2ab5-47ac-bf49-76fbca743872 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:52.046808 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-491ec31b-2ab5-47ac-bf49-76fbca743872 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Getting quotas for project 0712b807a4584f7b8f019ceb65ff1e14. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:32:52.050625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-491ec31b-2ab5-47ac-bf49-76fbca743872 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Getting quotas for user 5074b9fa045543b9a62bf751e736d0df and project 0712b807a4584f7b8f019ceb65ff1e14. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:32:52.062523 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-491ec31b-2ab5-47ac-bf49-76fbca743872 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Going to run 1 instances... {{(pid=117973) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:32:52.064801 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-491ec31b-2ab5-47ac-bf49-76fbca743872 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='807d39e3-2293-48ca-b2cd-675f7c931014',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:32:52.114783 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-491ec31b-2ab5-47ac-bf49-76fbca743872 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.639676 May 23 15:32:52.116157 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 207/418] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:32:51 2022] POST /compute/v2.1/servers => generated 409 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 15:32:52.125370 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-eb9f94f3-3474-4b23-8237-e98c2f5081ef tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:52.125979 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-eb9f94f3-3474-4b23-8237-e98c2f5081ef tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:52.181869 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-eb9f94f3-3474-4b23-8237-e98c2f5081ef tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:52.188793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-eb9f94f3-3474-4b23-8237-e98c2f5081ef tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1244 microversion: 2.1 time: 0.067129 May 23 15:32:52.189420 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 208/419] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:52 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1244 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:52.198387 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-6250282f-d7cd-4d31-b923-e9dc349808d8 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:52.199382 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-6250282f-d7cd-4d31-b923-e9dc349808d8 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:52.205771 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6250282f-d7cd-4d31-b923-e9dc349808d8 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:52.206219 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6250282f-d7cd-4d31-b923-e9dc349808d8 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:52.206992 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6250282f-d7cd-4d31-b923-e9dc349808d8 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:52.207416 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6250282f-d7cd-4d31-b923-e9dc349808d8 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:52.352824 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-6250282f-d7cd-4d31-b923-e9dc349808d8 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:52.361883 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-6250282f-d7cd-4d31-b923-e9dc349808d8 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1366 microversion: 2.1 time: 0.167428 May 23 15:32:52.362980 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 209/420] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:52 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:52.367463 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8a664864-4f86-4b72-a31e-6da0674149fd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:52.368075 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8a664864-4f86-4b72-a31e-6da0674149fd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:52.375998 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8a664864-4f86-4b72-a31e-6da0674149fd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:52.376451 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8a664864-4f86-4b72-a31e-6da0674149fd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:52.377255 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8a664864-4f86-4b72-a31e-6da0674149fd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:52.377699 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8a664864-4f86-4b72-a31e-6da0674149fd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:52.517744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO oslo.messaging._drivers.impl_rabbit [None req-7e638131-45c7-4763-8d44-9f3abbdd7dcd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [941b5830-4cba-418c-bb33-71cbe1300b9e] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 44184. May 23 15:32:52.522159 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-7e638131-45c7-4763-8d44-9f3abbdd7dcd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "POST /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/action" status: 202 len: 0 microversion: 2.20 time: 1.140141 May 23 15:32:52.522974 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 212/421] 10.222.0.30 () {62 vars in 1318 bytes} [Mon May 23 15:32:51 2022] POST /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/action => generated 0 bytes in 1142 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 15:32:52.532999 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c9df58ce-b87c-4f74-8fe7-7043a2fddc75 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:52.534873 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-c9df58ce-b87c-4f74-8fe7-7043a2fddc75 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:52.542524 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c9df58ce-b87c-4f74-8fe7-7043a2fddc75 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:52.543296 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c9df58ce-b87c-4f74-8fe7-7043a2fddc75 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:52.544138 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c9df58ce-b87c-4f74-8fe7-7043a2fddc75 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:52.544768 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c9df58ce-b87c-4f74-8fe7-7043a2fddc75 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:52.557658 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8a664864-4f86-4b72-a31e-6da0674149fd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:52.568282 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8a664864-4f86-4b72-a31e-6da0674149fd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1721 microversion: 2.1 time: 0.203749 May 23 15:32:52.579149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 210/422] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:52 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:52.698665 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c9df58ce-b87c-4f74-8fe7-7043a2fddc75 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:52.708562 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c9df58ce-b87c-4f74-8fe7-7043a2fddc75 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:52.710533 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c9df58ce-b87c-4f74-8fe7-7043a2fddc75 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:52.711884 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-c9df58ce-b87c-4f74-8fe7-7043a2fddc75 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1751 microversion: 2.20 time: 0.182997 May 23 15:32:52.712732 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 213/423] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:52 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:53.205760 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a8026b17-6c1e-4313-8679-89298a4aaeec tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:53.207036 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-a8026b17-6c1e-4313-8679-89298a4aaeec tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:53.213999 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a8026b17-6c1e-4313-8679-89298a4aaeec tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:53.214548 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a8026b17-6c1e-4313-8679-89298a4aaeec tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:53.215323 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a8026b17-6c1e-4313-8679-89298a4aaeec tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:53.215767 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a8026b17-6c1e-4313-8679-89298a4aaeec tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:53.282078 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a8026b17-6c1e-4313-8679-89298a4aaeec tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:53.291183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a8026b17-6c1e-4313-8679-89298a4aaeec tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1240 microversion: 2.1 time: 0.089139 May 23 15:32:53.292930 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 211/424] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:53 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:53.379228 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-96c737d1-82c9-44b7-843e-398f97760a89 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:53.380376 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-96c737d1-82c9-44b7-843e-398f97760a89 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:53.387533 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96c737d1-82c9-44b7-843e-398f97760a89 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:53.388073 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96c737d1-82c9-44b7-843e-398f97760a89 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:53.389988 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96c737d1-82c9-44b7-843e-398f97760a89 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:53.390511 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96c737d1-82c9-44b7-843e-398f97760a89 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:53.545817 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-96c737d1-82c9-44b7-843e-398f97760a89 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:53.558298 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-96c737d1-82c9-44b7-843e-398f97760a89 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1555 microversion: 2.1 time: 0.182884 May 23 15:32:53.558876 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 214/425] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:53 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1555 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:53.576525 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-154edce2-1a25-4eaa-ad4a-8ef0d35588ed tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:53.577142 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-154edce2-1a25-4eaa-ad4a-8ef0d35588ed tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:53.587378 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-0ab23d35-22b7-4c24-bef1-e0812711ef6d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:53.588009 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-0ab23d35-22b7-4c24-bef1-e0812711ef6d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:53.594891 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-154edce2-1a25-4eaa-ad4a-8ef0d35588ed tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:53.595341 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-154edce2-1a25-4eaa-ad4a-8ef0d35588ed tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:53.596131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-154edce2-1a25-4eaa-ad4a-8ef0d35588ed tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:53.596591 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-154edce2-1a25-4eaa-ad4a-8ef0d35588ed tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:53.603858 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0ab23d35-22b7-4c24-bef1-e0812711ef6d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:53.605339 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0ab23d35-22b7-4c24-bef1-e0812711ef6d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:53.606804 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0ab23d35-22b7-4c24-bef1-e0812711ef6d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:53.620232 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0ab23d35-22b7-4c24-bef1-e0812711ef6d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:53.725840 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-154edce2-1a25-4eaa-ad4a-8ef0d35588ed tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.154884 May 23 15:32:53.726436 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 212/426] 10.222.0.30 () {58 vars in 1274 bytes} [Mon May 23 15:32:53 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:32:53.731540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c7f99f3a-0655-4e04-afd9-d262b3181cca tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:53.732532 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c7f99f3a-0655-4e04-afd9-d262b3181cca tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:53.740339 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c7f99f3a-0655-4e04-afd9-d262b3181cca tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:53.740837 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c7f99f3a-0655-4e04-afd9-d262b3181cca tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:53.741822 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c7f99f3a-0655-4e04-afd9-d262b3181cca tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:53.742276 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c7f99f3a-0655-4e04-afd9-d262b3181cca tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:53.769439 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:53.799054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0ab23d35-22b7-4c24-bef1-e0812711ef6d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:53.808798 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-0ab23d35-22b7-4c24-bef1-e0812711ef6d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1721 microversion: 2.1 time: 0.224811 May 23 15:32:53.809398 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 215/427] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:53 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:54.012783 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c7f99f3a-0655-4e04-afd9-d262b3181cca tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:54.022517 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c7f99f3a-0655-4e04-afd9-d262b3181cca tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:54.024165 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c7f99f3a-0655-4e04-afd9-d262b3181cca tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:54.025489 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c7f99f3a-0655-4e04-afd9-d262b3181cca tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1751 microversion: 2.20 time: 0.297873 May 23 15:32:54.026126 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 213/428] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:53 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1751 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:54.313466 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-1b17730a-cd91-4ac1-9ee5-7e4c959d5edb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:54.314275 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-1b17730a-cd91-4ac1-9ee5-7e4c959d5edb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:54.322735 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1b17730a-cd91-4ac1-9ee5-7e4c959d5edb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:54.324339 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1b17730a-cd91-4ac1-9ee5-7e4c959d5edb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:54.327944 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1b17730a-cd91-4ac1-9ee5-7e4c959d5edb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:54.328753 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1b17730a-cd91-4ac1-9ee5-7e4c959d5edb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:54.400933 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1b17730a-cd91-4ac1-9ee5-7e4c959d5edb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:54.408781 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-1b17730a-cd91-4ac1-9ee5-7e4c959d5edb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1314 microversion: 2.1 time: 0.101841 May 23 15:32:54.409548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 216/429] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:54 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1314 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:54.825802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-94ba9f35-cd73-489a-a792-7b96f1e00bc2 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:54.826421 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-94ba9f35-cd73-489a-a792-7b96f1e00bc2 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:54.832925 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-94ba9f35-cd73-489a-a792-7b96f1e00bc2 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:54.833392 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-94ba9f35-cd73-489a-a792-7b96f1e00bc2 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:54.834169 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-94ba9f35-cd73-489a-a792-7b96f1e00bc2 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:54.834614 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-94ba9f35-cd73-489a-a792-7b96f1e00bc2 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:55.045144 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-425b3a2e-1dae-43fd-acc7-21692f302879 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:55.046202 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-425b3a2e-1dae-43fd-acc7-21692f302879 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:55.053255 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-425b3a2e-1dae-43fd-acc7-21692f302879 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:55.053844 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-425b3a2e-1dae-43fd-acc7-21692f302879 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:55.054624 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-425b3a2e-1dae-43fd-acc7-21692f302879 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:55.055068 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-425b3a2e-1dae-43fd-acc7-21692f302879 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:55.152573 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-94ba9f35-cd73-489a-a792-7b96f1e00bc2 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:55.171195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-94ba9f35-cd73-489a-a792-7b96f1e00bc2 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1721 microversion: 2.1 time: 0.349306 May 23 15:32:55.172544 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 214/430] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:54 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1721 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:55.203832 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-8f55258a-2b2d-4f57-a9f0-2456dd83d8c0 req-2e160944-27eb-4705-921f-d6e2ea527258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc0f4046-cea9-4426-9970-4ff8f307a3c0", "tag": "5ecea450-0a05-473a-b7b2-1cd3cef1fd28"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:32:55.213064 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-425b3a2e-1dae-43fd-acc7-21692f302879 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:55.213726 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-8f55258a-2b2d-4f57-a9f0-2456dd83d8c0 req-2e160944-27eb-4705-921f-d6e2ea527258 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:55.214169 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-8f55258a-2b2d-4f57-a9f0-2456dd83d8c0 req-2e160944-27eb-4705-921f-d6e2ea527258 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:55.224740 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-425b3a2e-1dae-43fd-acc7-21692f302879 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:55.226718 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-8f55258a-2b2d-4f57-a9f0-2456dd83d8c0 req-2e160944-27eb-4705-921f-d6e2ea527258 service nova] Creating event network-changed:5ecea450-0a05-473a-b7b2-1cd3cef1fd28 for instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 on hv-cinder-84112 May 23 15:32:55.227441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-425b3a2e-1dae-43fd-acc7-21692f302879 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:55.229282 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-425b3a2e-1dae-43fd-acc7-21692f302879 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1753 microversion: 2.20 time: 0.187929 May 23 15:32:55.231042 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 217/431] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:55 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:32:55.236241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-8f55258a-2b2d-4f57-a9f0-2456dd83d8c0 req-2e160944-27eb-4705-921f-d6e2ea527258 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035943 May 23 15:32:55.237040 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 215/432] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:32:55.425964 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ce6e963e-4ca1-466c-ac13-bf91dbbec094 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:55.426907 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ce6e963e-4ca1-466c-ac13-bf91dbbec094 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:55.434709 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ce6e963e-4ca1-466c-ac13-bf91dbbec094 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:55.435454 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ce6e963e-4ca1-466c-ac13-bf91dbbec094 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:55.436513 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ce6e963e-4ca1-466c-ac13-bf91dbbec094 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:55.437060 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ce6e963e-4ca1-466c-ac13-bf91dbbec094 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:55.452551 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:55.612810 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ce6e963e-4ca1-466c-ac13-bf91dbbec094 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:55.622826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ce6e963e-4ca1-466c-ac13-bf91dbbec094 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.200554 May 23 15:32:55.623430 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 218/433] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:55 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:56.190003 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-da226f80-6ab2-49fb-8e21-1c59f69d1b3d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:56.190776 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-da226f80-6ab2-49fb-8e21-1c59f69d1b3d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:56.192837 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:56.199215 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-da226f80-6ab2-49fb-8e21-1c59f69d1b3d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:56.199667 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-da226f80-6ab2-49fb-8e21-1c59f69d1b3d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:56.200458 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-da226f80-6ab2-49fb-8e21-1c59f69d1b3d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:56.200917 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-da226f80-6ab2-49fb-8e21-1c59f69d1b3d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:56.252603 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a4212c0b-effd-4921-956b-3a3284bf213b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:56.253199 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a4212c0b-effd-4921-956b-3a3284bf213b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:56.259872 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a4212c0b-effd-4921-956b-3a3284bf213b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:56.260933 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a4212c0b-effd-4921-956b-3a3284bf213b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:56.261955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a4212c0b-effd-4921-956b-3a3284bf213b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:56.262399 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a4212c0b-effd-4921-956b-3a3284bf213b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:56.420515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a4212c0b-effd-4921-956b-3a3284bf213b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:56.435775 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a4212c0b-effd-4921-956b-3a3284bf213b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:56.437619 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a4212c0b-effd-4921-956b-3a3284bf213b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:56.439072 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a4212c0b-effd-4921-956b-3a3284bf213b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1753 microversion: 2.20 time: 0.190635 May 23 15:32:56.439641 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 219/434] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:56 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1753 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:32:56.572747 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-da226f80-6ab2-49fb-8e21-1c59f69d1b3d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:56.581737 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-da226f80-6ab2-49fb-8e21-1c59f69d1b3d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1721 microversion: 2.1 time: 0.396469 May 23 15:32:56.582356 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 216/435] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:56 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1721 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:56.642897 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f5a899db-d21b-451b-b156-ce51684f9787 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:56.643519 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f5a899db-d21b-451b-b156-ce51684f9787 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:56.649655 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f5a899db-d21b-451b-b156-ce51684f9787 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:56.650110 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f5a899db-d21b-451b-b156-ce51684f9787 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:56.650879 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f5a899db-d21b-451b-b156-ce51684f9787 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:56.651571 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f5a899db-d21b-451b-b156-ce51684f9787 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:56.785616 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-f5a899db-d21b-451b-b156-ce51684f9787 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:56.793057 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f5a899db-d21b-451b-b156-ce51684f9787 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.157074 May 23 15:32:56.793624 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 220/436] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:56 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:57.458288 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-131b433a-29fc-4772-80e0-9028e42994b3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:57.458823 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-131b433a-29fc-4772-80e0-9028e42994b3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:57.465814 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-131b433a-29fc-4772-80e0-9028e42994b3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:57.466267 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-131b433a-29fc-4772-80e0-9028e42994b3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:57.467030 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-131b433a-29fc-4772-80e0-9028e42994b3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:57.467467 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-131b433a-29fc-4772-80e0-9028e42994b3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:57.596813 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-131b433a-29fc-4772-80e0-9028e42994b3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:57.598891 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-83d4361b-2774-486f-9558-1541e811aa78 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:57.599517 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-83d4361b-2774-486f-9558-1541e811aa78 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:57.606512 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-131b433a-29fc-4772-80e0-9028e42994b3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:57.606708 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-83d4361b-2774-486f-9558-1541e811aa78 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:57.607030 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-83d4361b-2774-486f-9558-1541e811aa78 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:57.607802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-83d4361b-2774-486f-9558-1541e811aa78 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:57.608145 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-131b433a-29fc-4772-80e0-9028e42994b3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:57.608266 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-83d4361b-2774-486f-9558-1541e811aa78 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:57.609356 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-131b433a-29fc-4772-80e0-9028e42994b3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1753 microversion: 2.20 time: 0.155152 May 23 15:32:57.610274 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 217/437] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:57 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:57.738251 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-83d4361b-2774-486f-9558-1541e811aa78 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:57.746240 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-83d4361b-2774-486f-9558-1541e811aa78 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1721 microversion: 2.1 time: 0.151133 May 23 15:32:57.746813 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 221/438] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:57 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:57.809579 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8d1935de-7973-4072-864d-d0602a5bb33e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:57.810222 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8d1935de-7973-4072-864d-d0602a5bb33e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:57.816203 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8d1935de-7973-4072-864d-d0602a5bb33e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:57.816721 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8d1935de-7973-4072-864d-d0602a5bb33e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:57.817541 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8d1935de-7973-4072-864d-d0602a5bb33e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:57.817982 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8d1935de-7973-4072-864d-d0602a5bb33e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:57.955292 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8d1935de-7973-4072-864d-d0602a5bb33e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:57.967831 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8d1935de-7973-4072-864d-d0602a5bb33e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.161919 May 23 15:32:57.968782 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 218/439] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:57 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:58.627304 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a637daad-7415-40fc-9066-c940437c99b1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:58.627918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a637daad-7415-40fc-9066-c940437c99b1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:58.634584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a637daad-7415-40fc-9066-c940437c99b1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:58.635040 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a637daad-7415-40fc-9066-c940437c99b1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:58.636336 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a637daad-7415-40fc-9066-c940437c99b1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:58.636778 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a637daad-7415-40fc-9066-c940437c99b1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:58.763558 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-076d3d1e-e9b3-4c02-bd93-42d826044b15 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:58.764465 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-076d3d1e-e9b3-4c02-bd93-42d826044b15 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:58.764661 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a637daad-7415-40fc-9066-c940437c99b1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:58.771136 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-076d3d1e-e9b3-4c02-bd93-42d826044b15 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:58.771626 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-076d3d1e-e9b3-4c02-bd93-42d826044b15 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:58.772399 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-076d3d1e-e9b3-4c02-bd93-42d826044b15 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:58.772884 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-076d3d1e-e9b3-4c02-bd93-42d826044b15 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:58.773216 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a637daad-7415-40fc-9066-c940437c99b1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:58.774715 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a637daad-7415-40fc-9066-c940437c99b1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:58.775873 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a637daad-7415-40fc-9066-c940437c99b1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1753 microversion: 2.20 time: 0.152530 May 23 15:32:58.777273 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 222/440] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:58 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:32:58.910080 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-076d3d1e-e9b3-4c02-bd93-42d826044b15 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:58.918755 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-076d3d1e-e9b3-4c02-bd93-42d826044b15 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1721 microversion: 2.1 time: 0.159505 May 23 15:32:58.919352 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 219/441] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:58 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:32:58.984447 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4c7164bf-378c-48c3-a0e0-e55743b331d5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:58.985103 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4c7164bf-378c-48c3-a0e0-e55743b331d5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:58.991169 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c7164bf-378c-48c3-a0e0-e55743b331d5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:58.991618 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c7164bf-378c-48c3-a0e0-e55743b331d5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:58.992382 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c7164bf-378c-48c3-a0e0-e55743b331d5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:58.992817 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c7164bf-378c-48c3-a0e0-e55743b331d5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:59.122168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4c7164bf-378c-48c3-a0e0-e55743b331d5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:59.129540 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4c7164bf-378c-48c3-a0e0-e55743b331d5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.148914 May 23 15:32:59.130111 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 223/442] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:58 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:32:59.794288 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a0f36334-b725-4f9f-8dbc-0eb5dac7fab1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:59.794907 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-a0f36334-b725-4f9f-8dbc-0eb5dac7fab1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:59.801457 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a0f36334-b725-4f9f-8dbc-0eb5dac7fab1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:59.801915 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a0f36334-b725-4f9f-8dbc-0eb5dac7fab1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:59.802683 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a0f36334-b725-4f9f-8dbc-0eb5dac7fab1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:59.803127 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a0f36334-b725-4f9f-8dbc-0eb5dac7fab1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:59.947688 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-31cf0218-1f03-48d9-8f56-dd8d86f9667c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:59.949028 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a0f36334-b725-4f9f-8dbc-0eb5dac7fab1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:59.949160 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-31cf0218-1f03-48d9-8f56-dd8d86f9667c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:32:59.950868 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=4 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:59.956550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-31cf0218-1f03-48d9-8f56-dd8d86f9667c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:59.957051 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-31cf0218-1f03-48d9-8f56-dd8d86f9667c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:59.957847 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-31cf0218-1f03-48d9-8f56-dd8d86f9667c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:59.958149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a0f36334-b725-4f9f-8dbc-0eb5dac7fab1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:59.958273 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-31cf0218-1f03-48d9-8f56-dd8d86f9667c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:59.959725 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a0f36334-b725-4f9f-8dbc-0eb5dac7fab1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:32:59.961148 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a0f36334-b725-4f9f-8dbc-0eb5dac7fab1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1753 microversion: 2.20 time: 0.171149 May 23 15:32:59.961732 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 220/443] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:32:59 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:33:00.089090 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-31cf0218-1f03-48d9-8f56-dd8d86f9667c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:00.096982 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-31cf0218-1f03-48d9-8f56-dd8d86f9667c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1721 microversion: 2.1 time: 0.153253 May 23 15:33:00.097559 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 224/444] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:32:59 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:33:00.146866 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-66e7c753-9978-484c-9372-61abfda05188 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:00.147485 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-66e7c753-9978-484c-9372-61abfda05188 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:00.154041 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-66e7c753-9978-484c-9372-61abfda05188 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:00.154504 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-66e7c753-9978-484c-9372-61abfda05188 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:00.155286 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-66e7c753-9978-484c-9372-61abfda05188 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:00.155728 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-66e7c753-9978-484c-9372-61abfda05188 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:00.281483 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-66e7c753-9978-484c-9372-61abfda05188 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:00.288933 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-66e7c753-9978-484c-9372-61abfda05188 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.145868 May 23 15:33:00.289495 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 221/445] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:00 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:00.979756 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-9879f187-5b4c-4193-9352-d9266aef5cbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:00.980477 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-9879f187-5b4c-4193-9352-d9266aef5cbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:00.995603 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9879f187-5b4c-4193-9352-d9266aef5cbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:00.996070 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9879f187-5b4c-4193-9352-d9266aef5cbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:00.996859 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9879f187-5b4c-4193-9352-d9266aef5cbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:00.997330 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9879f187-5b4c-4193-9352-d9266aef5cbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:01.115328 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-94c15dbd-5419-4bcd-865c-001cf3e39eb3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:01.116544 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-94c15dbd-5419-4bcd-865c-001cf3e39eb3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:01.126420 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-94c15dbd-5419-4bcd-865c-001cf3e39eb3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:01.126725 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-94c15dbd-5419-4bcd-865c-001cf3e39eb3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:01.131847 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-94c15dbd-5419-4bcd-865c-001cf3e39eb3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:01.133114 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-94c15dbd-5419-4bcd-865c-001cf3e39eb3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:01.159979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9879f187-5b4c-4193-9352-d9266aef5cbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:01.168960 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9879f187-5b4c-4193-9352-d9266aef5cbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:01.170562 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9879f187-5b4c-4193-9352-d9266aef5cbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:01.172005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-9879f187-5b4c-4193-9352-d9266aef5cbd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1753 microversion: 2.20 time: 0.196209 May 23 15:33:01.173014 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 225/446] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:00 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1753 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:01.238509 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-0a632639-b29f-43b8-9cab-67b58706868e req-6d08ab21-b4b7-4a10-ab3c-f896e2c2949c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb26539d-bd10-48dd-9c5d-433060babfb6", "tag": "e105091f-4632-47d3-b731-412205a70375"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:01.248642 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-0a632639-b29f-43b8-9cab-67b58706868e req-6d08ab21-b4b7-4a10-ab3c-f896e2c2949c service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:01.249261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-0a632639-b29f-43b8-9cab-67b58706868e req-6d08ab21-b4b7-4a10-ab3c-f896e2c2949c service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:01.269225 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-0a632639-b29f-43b8-9cab-67b58706868e req-6d08ab21-b4b7-4a10-ab3c-f896e2c2949c service nova] Creating event network-changed:e105091f-4632-47d3-b731-412205a70375 for instance bb26539d-bd10-48dd-9c5d-433060babfb6 on hv-cinder-84112 May 23 15:33:01.275133 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-0a632639-b29f-43b8-9cab-67b58706868e req-6d08ab21-b4b7-4a10-ab3c-f896e2c2949c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040518 May 23 15:33:01.275865 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 226/447] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:01.306737 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-af1b494c-382c-462f-803f-c09239185c52 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:01.307984 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-af1b494c-382c-462f-803f-c09239185c52 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:01.314800 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-af1b494c-382c-462f-803f-c09239185c52 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:01.315265 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-af1b494c-382c-462f-803f-c09239185c52 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:01.316058 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-af1b494c-382c-462f-803f-c09239185c52 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:01.316504 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-af1b494c-382c-462f-803f-c09239185c52 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:01.325494 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-94c15dbd-5419-4bcd-865c-001cf3e39eb3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:01.333658 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-94c15dbd-5419-4bcd-865c-001cf3e39eb3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1721 microversion: 2.1 time: 0.222752 May 23 15:33:01.334522 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 222/448] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:01 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:33:01.462125 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-af1b494c-382c-462f-803f-c09239185c52 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:01.472385 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-af1b494c-382c-462f-803f-c09239185c52 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.169846 May 23 15:33:01.473119 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 227/449] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:01 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:33:02.191690 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-9832413c-7b97-421f-ab97-a9657d1e9eed tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:02.192413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-9832413c-7b97-421f-ab97-a9657d1e9eed tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:02.194463 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:02.195832 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=8 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:02.201692 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9832413c-7b97-421f-ab97-a9657d1e9eed tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:02.202281 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9832413c-7b97-421f-ab97-a9657d1e9eed tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:02.203187 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9832413c-7b97-421f-ab97-a9657d1e9eed tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:02.203738 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9832413c-7b97-421f-ab97-a9657d1e9eed tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:02.277395 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5b477679-4afc-4f93-81ce-d98c8c923f41 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:02.278102 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-5b477679-4afc-4f93-81ce-d98c8c923f41 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:02.285307 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5b477679-4afc-4f93-81ce-d98c8c923f41 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:02.285760 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5b477679-4afc-4f93-81ce-d98c8c923f41 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:02.286545 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5b477679-4afc-4f93-81ce-d98c8c923f41 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:02.286990 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5b477679-4afc-4f93-81ce-d98c8c923f41 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:02.455735 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-5b477679-4afc-4f93-81ce-d98c8c923f41 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:02.465942 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5b477679-4afc-4f93-81ce-d98c8c923f41 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1593 microversion: 2.1 time: 0.193419 May 23 15:33:02.466632 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 228/450] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:02 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1593 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:02.471514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-33e7af84-0bc4-4c2e-ba3d-3cb09f0942ba tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:02.472224 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-33e7af84-0bc4-4c2e-ba3d-3cb09f0942ba tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:02.479744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-33e7af84-0bc4-4c2e-ba3d-3cb09f0942ba tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:02.481782 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-33e7af84-0bc4-4c2e-ba3d-3cb09f0942ba tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:02.483070 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-33e7af84-0bc4-4c2e-ba3d-3cb09f0942ba tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:02.483697 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-33e7af84-0bc4-4c2e-ba3d-3cb09f0942ba tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:02.496015 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9832413c-7b97-421f-ab97-a9657d1e9eed tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:02.522794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9832413c-7b97-421f-ab97-a9657d1e9eed tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:02.524751 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9832413c-7b97-421f-ab97-a9657d1e9eed tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:02.527006 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-9832413c-7b97-421f-ab97-a9657d1e9eed tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1753 microversion: 2.20 time: 0.338762 May 23 15:33:02.527801 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 223/451] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:02 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1753 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:02.534262 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-fe11f890-8571-4e56-a7c8-c2b7b8566713 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:02.535139 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-fe11f890-8571-4e56-a7c8-c2b7b8566713 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:02.544441 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fe11f890-8571-4e56-a7c8-c2b7b8566713 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:02.544647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fe11f890-8571-4e56-a7c8-c2b7b8566713 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:02.546463 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fe11f890-8571-4e56-a7c8-c2b7b8566713 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:02.547643 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fe11f890-8571-4e56-a7c8-c2b7b8566713 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:02.684947 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-33e7af84-0bc4-4c2e-ba3d-3cb09f0942ba tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:02.696484 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-33e7af84-0bc4-4c2e-ba3d-3cb09f0942ba tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1721 microversion: 2.1 time: 0.228510 May 23 15:33:02.709107 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 229/452] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:02 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:02.778270 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-fe11f890-8571-4e56-a7c8-c2b7b8566713 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:02.786569 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-fe11f890-8571-4e56-a7c8-c2b7b8566713 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.256627 May 23 15:33:02.787327 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 224/453] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:02 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:03.546096 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4d994741-7a79-4380-adff-058d77961818 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:03.546714 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4d994741-7a79-4380-adff-058d77961818 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:03.552949 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4d994741-7a79-4380-adff-058d77961818 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:03.553410 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4d994741-7a79-4380-adff-058d77961818 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:03.554182 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4d994741-7a79-4380-adff-058d77961818 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:03.554626 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4d994741-7a79-4380-adff-058d77961818 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:03.714899 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-9e6d00a9-2db2-4369-916a-a41e5d67b70d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:03.715520 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-9e6d00a9-2db2-4369-916a-a41e5d67b70d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:03.722071 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9e6d00a9-2db2-4369-916a-a41e5d67b70d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:03.722536 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9e6d00a9-2db2-4369-916a-a41e5d67b70d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:03.723312 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9e6d00a9-2db2-4369-916a-a41e5d67b70d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:03.723754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9e6d00a9-2db2-4369-916a-a41e5d67b70d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:03.767165 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4d994741-7a79-4380-adff-058d77961818 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:03.776267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4d994741-7a79-4380-adff-058d77961818 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:03.777897 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4d994741-7a79-4380-adff-058d77961818 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:03.779069 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4d994741-7a79-4380-adff-058d77961818 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.237553 May 23 15:33:03.780146 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 230/454] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:03 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:33:03.808330 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a2ce1dbf-41cb-4864-8cba-70a5b406ee1d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:03.809861 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a2ce1dbf-41cb-4864-8cba-70a5b406ee1d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:03.816078 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a2ce1dbf-41cb-4864-8cba-70a5b406ee1d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:03.816610 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a2ce1dbf-41cb-4864-8cba-70a5b406ee1d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:03.817491 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a2ce1dbf-41cb-4864-8cba-70a5b406ee1d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:03.818237 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a2ce1dbf-41cb-4864-8cba-70a5b406ee1d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:03.859937 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9e6d00a9-2db2-4369-916a-a41e5d67b70d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:03.868402 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-9e6d00a9-2db2-4369-916a-a41e5d67b70d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1721 microversion: 2.1 time: 0.158111 May 23 15:33:03.869219 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 225/455] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:03 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:33:04.265457 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a2ce1dbf-41cb-4864-8cba-70a5b406ee1d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:04.279341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a2ce1dbf-41cb-4864-8cba-70a5b406ee1d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.476489 May 23 15:33:04.284906 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 231/456] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:03 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:33:04.642256 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-d7bc13f1-115e-400f-b50a-9b31b1c7f9cb req-8c7b2df3-b182-4dd5-a453-056cf64e55d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55f39cba-5943-42d5-9322-58f3af0d39f8", "tag": "d674721e-f3c3-41d6-99a3-5276229c8c17"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:04.652670 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-d7bc13f1-115e-400f-b50a-9b31b1c7f9cb req-8c7b2df3-b182-4dd5-a453-056cf64e55d9 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:04.653398 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-d7bc13f1-115e-400f-b50a-9b31b1c7f9cb req-8c7b2df3-b182-4dd5-a453-056cf64e55d9 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:04.671557 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-d7bc13f1-115e-400f-b50a-9b31b1c7f9cb req-8c7b2df3-b182-4dd5-a453-056cf64e55d9 service nova] Creating event network-changed:d674721e-f3c3-41d6-99a3-5276229c8c17 for instance 55f39cba-5943-42d5-9322-58f3af0d39f8 on hv-cinder-84112 May 23 15:33:04.678069 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-d7bc13f1-115e-400f-b50a-9b31b1c7f9cb req-8c7b2df3-b182-4dd5-a453-056cf64e55d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038914 May 23 15:33:04.679305 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 226/457] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:04.798834 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-41e739ee-c7dd-42e7-a93f-7cec8c0c544e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:04.799438 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-41e739ee-c7dd-42e7-a93f-7cec8c0c544e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:04.805657 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-41e739ee-c7dd-42e7-a93f-7cec8c0c544e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:04.806105 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-41e739ee-c7dd-42e7-a93f-7cec8c0c544e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:04.806875 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-41e739ee-c7dd-42e7-a93f-7cec8c0c544e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:04.807376 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-41e739ee-c7dd-42e7-a93f-7cec8c0c544e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:04.888774 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a3c510ab-7ff6-4e7f-87e0-c4c995c179e9 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:04.890532 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-a3c510ab-7ff6-4e7f-87e0-c4c995c179e9 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:04.900038 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a3c510ab-7ff6-4e7f-87e0-c4c995c179e9 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:04.901986 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a3c510ab-7ff6-4e7f-87e0-c4c995c179e9 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:04.903153 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a3c510ab-7ff6-4e7f-87e0-c4c995c179e9 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:04.903895 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a3c510ab-7ff6-4e7f-87e0-c4c995c179e9 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:04.986318 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-41e739ee-c7dd-42e7-a93f-7cec8c0c544e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:05.004130 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-41e739ee-c7dd-42e7-a93f-7cec8c0c544e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:05.007086 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-41e739ee-c7dd-42e7-a93f-7cec8c0c544e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:05.009708 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-41e739ee-c7dd-42e7-a93f-7cec8c0c544e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.214986 May 23 15:33:05.011600 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 232/458] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:04 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:05.276849 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a3c510ab-7ff6-4e7f-87e0-c4c995c179e9 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:05.287373 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a3c510ab-7ff6-4e7f-87e0-c4c995c179e9 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1698 microversion: 2.1 time: 0.403978 May 23 15:33:05.290732 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 227/459] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:04 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1698 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:33:05.301835 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-422c3384-2107-4902-bb8e-043b5415b328 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:05.302831 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-422c3384-2107-4902-bb8e-043b5415b328 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:05.311158 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c2bef4c1-d549-4d31-a3b3-d8e274cb24dd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:05.321012 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c2bef4c1-d549-4d31-a3b3-d8e274cb24dd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:05.321467 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c2bef4c1-d549-4d31-a3b3-d8e274cb24dd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:05.321644 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-422c3384-2107-4902-bb8e-043b5415b328 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:05.322348 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-422c3384-2107-4902-bb8e-043b5415b328 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:05.329529 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-422c3384-2107-4902-bb8e-043b5415b328 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:05.330044 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-422c3384-2107-4902-bb8e-043b5415b328 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:05.420745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c2bef4c1-d549-4d31-a3b3-d8e274cb24dd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Going to try to start instance {{(pid=117973) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 15:33:05.503732 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c2bef4c1-d549-4d31-a3b3-d8e274cb24dd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "POST /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/action" status: 202 len: 0 microversion: 2.1 time: 0.196718 May 23 15:33:05.508173 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 228/460] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 15:33:05 2022] POST /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:33:05.530341 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-06bbd534-645c-4bea-a7df-e7330c29b980 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:05.532839 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-06bbd534-645c-4bea-a7df-e7330c29b980 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:05.551102 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-06bbd534-645c-4bea-a7df-e7330c29b980 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:05.551869 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-06bbd534-645c-4bea-a7df-e7330c29b980 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:05.552955 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-06bbd534-645c-4bea-a7df-e7330c29b980 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:05.553623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-06bbd534-645c-4bea-a7df-e7330c29b980 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:05.767316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-422c3384-2107-4902-bb8e-043b5415b328 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:05.780823 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-422c3384-2107-4902-bb8e-043b5415b328 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.482882 May 23 15:33:05.793250 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 233/461] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:05 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:06.032932 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-aae39c2f-70f1-4e3c-86c7-9471b614a1c0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:06.034308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-aae39c2f-70f1-4e3c-86c7-9471b614a1c0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:06.048534 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aae39c2f-70f1-4e3c-86c7-9471b614a1c0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:06.051422 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aae39c2f-70f1-4e3c-86c7-9471b614a1c0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:06.055818 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aae39c2f-70f1-4e3c-86c7-9471b614a1c0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:06.056682 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aae39c2f-70f1-4e3c-86c7-9471b614a1c0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:06.273959 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-06bbd534-645c-4bea-a7df-e7330c29b980 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:06.283382 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-06bbd534-645c-4bea-a7df-e7330c29b980 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1707 microversion: 2.1 time: 0.773900 May 23 15:33:06.284238 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 229/462] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:05 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1707 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:06.396614 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-aae39c2f-70f1-4e3c-86c7-9471b614a1c0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:06.406875 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-aae39c2f-70f1-4e3c-86c7-9471b614a1c0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:06.409189 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-aae39c2f-70f1-4e3c-86c7-9471b614a1c0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:06.410443 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-aae39c2f-70f1-4e3c-86c7-9471b614a1c0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.382754 May 23 15:33:06.411009 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 234/463] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:06 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:33:06.659015 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-87a05989-8627-4912-b137-023dd5fa37fa tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-597829521"}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:06.659479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-87a05989-8627-4912-b137-023dd5fa37fa tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:06.665470 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-87a05989-8627-4912-b137-023dd5fa37fa tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:06.665921 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-87a05989-8627-4912-b137-023dd5fa37fa tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:06.667208 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-87a05989-8627-4912-b137-023dd5fa37fa tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:06.668154 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-87a05989-8627-4912-b137-023dd5fa37fa tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:06.682950 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:06.801307 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-22eef98b-b98c-4a26-a9da-3ff0e3c2fa80 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:06.802195 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-22eef98b-b98c-4a26-a9da-3ff0e3c2fa80 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:06.804559 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:06.818325 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-22eef98b-b98c-4a26-a9da-3ff0e3c2fa80 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:06.823485 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.network.security_group_api [None req-87a05989-8627-4912-b137-023dd5fa37fa tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Adding security group 97c8001c-8396-4cb5-abd4-1d2093ab8c66 to port d674721e-f3c3-41d6-99a3-5276229c8c17 May 23 15:33:06.827885 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-22eef98b-b98c-4a26-a9da-3ff0e3c2fa80 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:06.829014 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-22eef98b-b98c-4a26-a9da-3ff0e3c2fa80 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:06.829700 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-22eef98b-b98c-4a26-a9da-3ff0e3c2fa80 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:07.040301 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-22eef98b-b98c-4a26-a9da-3ff0e3c2fa80 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:07.043810 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=100 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:07.065303 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-22eef98b-b98c-4a26-a9da-3ff0e3c2fa80 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.268001 May 23 15:33:07.069905 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 235/464] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:06 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:07.306665 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-40164f6b-a15e-4443-bc7c-6d7d65add6af tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:07.308812 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-40164f6b-a15e-4443-bc7c-6d7d65add6af tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:07.320900 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-40164f6b-a15e-4443-bc7c-6d7d65add6af tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:07.327806 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-40164f6b-a15e-4443-bc7c-6d7d65add6af tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:07.329501 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-40164f6b-a15e-4443-bc7c-6d7d65add6af tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:07.330283 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-40164f6b-a15e-4443-bc7c-6d7d65add6af tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:07.559251 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-40164f6b-a15e-4443-bc7c-6d7d65add6af tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:07.568894 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-40164f6b-a15e-4443-bc7c-6d7d65add6af tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1707 microversion: 2.1 time: 0.271048 May 23 15:33:07.584836 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 236/465] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:07 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1707 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:33:07.594140 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3327354b-d8e4-4240-942a-8aefcd2b7c3f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:07.594769 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3327354b-d8e4-4240-942a-8aefcd2b7c3f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:07.602610 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3327354b-d8e4-4240-942a-8aefcd2b7c3f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:07.603067 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3327354b-d8e4-4240-942a-8aefcd2b7c3f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:07.603495 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-87a05989-8627-4912-b137-023dd5fa37fa tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "POST /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/action" status: 202 len: 0 microversion: 2.1 time: 0.948061 May 23 15:33:07.604227 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3327354b-d8e4-4240-942a-8aefcd2b7c3f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:07.611025 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3327354b-d8e4-4240-942a-8aefcd2b7c3f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:07.612521 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 230/466] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 15:33:06 2022] POST /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/action => generated 0 bytes in 958 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:33:07.621598 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-cfceb22e-9741-4683-ad93-b9122405c64a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:07.622560 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-cfceb22e-9741-4683-ad93-b9122405c64a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:07.641609 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cfceb22e-9741-4683-ad93-b9122405c64a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:07.644327 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cfceb22e-9741-4683-ad93-b9122405c64a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:07.645547 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cfceb22e-9741-4683-ad93-b9122405c64a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:07.646800 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cfceb22e-9741-4683-ad93-b9122405c64a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:07.916544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3327354b-d8e4-4240-942a-8aefcd2b7c3f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:07.938164 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3327354b-d8e4-4240-942a-8aefcd2b7c3f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:07.940547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3327354b-d8e4-4240-942a-8aefcd2b7c3f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:07.944355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3327354b-d8e4-4240-942a-8aefcd2b7c3f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.358295 May 23 15:33:07.951438 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 237/467] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:07 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:07.957125 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-4cbb5d00-a546-4427-b1fa-03ce10591388 req-a6c21bd1-c761-4163-b21b-deac2750fbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55f39cba-5943-42d5-9322-58f3af0d39f8", "tag": "d674721e-f3c3-41d6-99a3-5276229c8c17"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:07.967077 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-4cbb5d00-a546-4427-b1fa-03ce10591388 req-a6c21bd1-c761-4163-b21b-deac2750fbb4 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:07.967812 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-4cbb5d00-a546-4427-b1fa-03ce10591388 req-a6c21bd1-c761-4163-b21b-deac2750fbb4 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:07.993918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-4cbb5d00-a546-4427-b1fa-03ce10591388 req-a6c21bd1-c761-4163-b21b-deac2750fbb4 service nova] Creating event network-changed:d674721e-f3c3-41d6-99a3-5276229c8c17 for instance 55f39cba-5943-42d5-9322-58f3af0d39f8 on hv-cinder-84112 May 23 15:33:08.000708 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-4cbb5d00-a546-4427-b1fa-03ce10591388 req-a6c21bd1-c761-4163-b21b-deac2750fbb4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047347 May 23 15:33:08.001691 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 238/468] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:08.051837 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-cfceb22e-9741-4683-ad93-b9122405c64a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:08.063330 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-cfceb22e-9741-4683-ad93-b9122405c64a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1758 microversion: 2.1 time: 0.446325 May 23 15:33:08.075550 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 231/469] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:07 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1758 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:33:08.090728 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e3ab7589-7683-4130-a402-9af488caf973 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:08.091547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e3ab7589-7683-4130-a402-9af488caf973 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:08.105848 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e3ab7589-7683-4130-a402-9af488caf973 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:08.106573 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e3ab7589-7683-4130-a402-9af488caf973 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:08.115143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e3ab7589-7683-4130-a402-9af488caf973 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:08.115989 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e3ab7589-7683-4130-a402-9af488caf973 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:08.351800 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e3ab7589-7683-4130-a402-9af488caf973 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:08.362457 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e3ab7589-7683-4130-a402-9af488caf973 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.278428 May 23 15:33:08.363440 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 239/470] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:08 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:08.590504 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-9e9d226b-0af1-450c-808b-100ca3328a77 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:08.591463 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-9e9d226b-0af1-450c-808b-100ca3328a77 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:08.605709 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9e9d226b-0af1-450c-808b-100ca3328a77 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:08.609181 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9e9d226b-0af1-450c-808b-100ca3328a77 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:08.614238 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9e9d226b-0af1-450c-808b-100ca3328a77 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:08.614931 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9e9d226b-0af1-450c-808b-100ca3328a77 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:08.826179 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9e9d226b-0af1-450c-808b-100ca3328a77 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:08.840231 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-9e9d226b-0af1-450c-808b-100ca3328a77 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1707 microversion: 2.1 time: 0.254044 May 23 15:33:08.841519 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 232/471] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:08 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1707 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:08.971689 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4f1946b4-6ad9-4cbf-aeec-e358f6a0ac0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:08.972357 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4f1946b4-6ad9-4cbf-aeec-e358f6a0ac0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:08.980635 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4f1946b4-6ad9-4cbf-aeec-e358f6a0ac0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:08.981106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4f1946b4-6ad9-4cbf-aeec-e358f6a0ac0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:08.981877 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4f1946b4-6ad9-4cbf-aeec-e358f6a0ac0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:08.982326 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4f1946b4-6ad9-4cbf-aeec-e358f6a0ac0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:09.122441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4f1946b4-6ad9-4cbf-aeec-e358f6a0ac0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:09.131014 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4f1946b4-6ad9-4cbf-aeec-e358f6a0ac0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:09.132573 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4f1946b4-6ad9-4cbf-aeec-e358f6a0ac0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:09.133808 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4f1946b4-6ad9-4cbf-aeec-e358f6a0ac0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.167030 May 23 15:33:09.134367 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 240/472] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:08 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:09.379952 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f7df88ed-e355-4f83-8c05-cadf377a8941 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:09.380584 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f7df88ed-e355-4f83-8c05-cadf377a8941 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:09.388306 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f7df88ed-e355-4f83-8c05-cadf377a8941 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:09.389040 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f7df88ed-e355-4f83-8c05-cadf377a8941 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:09.390381 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f7df88ed-e355-4f83-8c05-cadf377a8941 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:09.391060 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f7df88ed-e355-4f83-8c05-cadf377a8941 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:09.532543 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f7df88ed-e355-4f83-8c05-cadf377a8941 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:09.541796 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f7df88ed-e355-4f83-8c05-cadf377a8941 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.165499 May 23 15:33:09.542941 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 233/473] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:09 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:09.858994 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-971220ab-ddca-4d68-974c-615ad913d3bd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:09.859707 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-971220ab-ddca-4d68-974c-615ad913d3bd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:09.865674 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-971220ab-ddca-4d68-974c-615ad913d3bd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:09.866120 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-971220ab-ddca-4d68-974c-615ad913d3bd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:09.866887 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-971220ab-ddca-4d68-974c-615ad913d3bd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:09.867323 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-971220ab-ddca-4d68-974c-615ad913d3bd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:09.989869 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-b9e35649-6dc9-4bff-b445-3332740c96dc req-3814cd5e-dda7-45f6-ac9e-892622fd2f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb26539d-bd10-48dd-9c5d-433060babfb6", "name": "network-vif-plugged", "status": "completed", "tag": "e105091f-4632-47d3-b731-412205a70375"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:10.002224 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-b9e35649-6dc9-4bff-b445-3332740c96dc req-3814cd5e-dda7-45f6-ac9e-892622fd2f48 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:10.002892 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-b9e35649-6dc9-4bff-b445-3332740c96dc req-3814cd5e-dda7-45f6-ac9e-892622fd2f48 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:10.023427 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-971220ab-ddca-4d68-974c-615ad913d3bd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:10.024918 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-b9e35649-6dc9-4bff-b445-3332740c96dc req-3814cd5e-dda7-45f6-ac9e-892622fd2f48 service nova] Creating event network-vif-plugged:e105091f-4632-47d3-b731-412205a70375 for instance bb26539d-bd10-48dd-9c5d-433060babfb6 on hv-cinder-84112 May 23 15:33:10.032051 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-b9e35649-6dc9-4bff-b445-3332740c96dc req-3814cd5e-dda7-45f6-ac9e-892622fd2f48 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046168 May 23 15:33:10.032798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 234/474] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:33:10.055583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-971220ab-ddca-4d68-974c-615ad913d3bd tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1707 microversion: 2.1 time: 0.201182 May 23 15:33:10.058712 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 241/475] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:09 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1707 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:10.154204 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3baf81a6-34e7-4f3d-9ebe-75789e40b031 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:10.157858 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-3baf81a6-34e7-4f3d-9ebe-75789e40b031 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:10.169669 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3baf81a6-34e7-4f3d-9ebe-75789e40b031 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:10.170468 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3baf81a6-34e7-4f3d-9ebe-75789e40b031 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:10.171666 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3baf81a6-34e7-4f3d-9ebe-75789e40b031 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:10.172601 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3baf81a6-34e7-4f3d-9ebe-75789e40b031 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:10.322270 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3baf81a6-34e7-4f3d-9ebe-75789e40b031 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:10.332521 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3baf81a6-34e7-4f3d-9ebe-75789e40b031 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:10.334203 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3baf81a6-34e7-4f3d-9ebe-75789e40b031 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:10.335599 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-3baf81a6-34e7-4f3d-9ebe-75789e40b031 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.186372 May 23 15:33:10.336240 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 235/476] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:10 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:10.559626 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8fedcf25-664d-4eb1-9f1e-1441e055f234 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:10.560316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8fedcf25-664d-4eb1-9f1e-1441e055f234 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:10.566922 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8fedcf25-664d-4eb1-9f1e-1441e055f234 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:10.567380 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8fedcf25-664d-4eb1-9f1e-1441e055f234 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:10.568162 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8fedcf25-664d-4eb1-9f1e-1441e055f234 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:10.568606 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8fedcf25-664d-4eb1-9f1e-1441e055f234 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:10.710666 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-8fedcf25-664d-4eb1-9f1e-1441e055f234 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:10.723138 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8fedcf25-664d-4eb1-9f1e-1441e055f234 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.167322 May 23 15:33:10.723908 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 242/477] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:10 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:11.077582 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-0dbfbefe-1268-466d-96bc-220b10057379 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:11.079170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-0dbfbefe-1268-466d-96bc-220b10057379 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:11.102338 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0dbfbefe-1268-466d-96bc-220b10057379 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:11.102794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0dbfbefe-1268-466d-96bc-220b10057379 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:11.103794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0dbfbefe-1268-466d-96bc-220b10057379 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:11.104087 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0dbfbefe-1268-466d-96bc-220b10057379 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:11.268414 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-0dbfbefe-1268-466d-96bc-220b10057379 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:11.277120 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-0dbfbefe-1268-466d-96bc-220b10057379 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1707 microversion: 2.1 time: 0.205550 May 23 15:33:11.277701 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 236/478] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:11 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1707 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:11.356840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ea69ab95-4653-4bcf-864c-22ced5f334be tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:11.358331 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ea69ab95-4653-4bcf-864c-22ced5f334be tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:11.377236 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ea69ab95-4653-4bcf-864c-22ced5f334be tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:11.378005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ea69ab95-4653-4bcf-864c-22ced5f334be tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:11.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ea69ab95-4653-4bcf-864c-22ced5f334be tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:11.379876 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ea69ab95-4653-4bcf-864c-22ced5f334be tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:11.592063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ea69ab95-4653-4bcf-864c-22ced5f334be tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:11.615529 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ea69ab95-4653-4bcf-864c-22ced5f334be tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:11.617705 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ea69ab95-4653-4bcf-864c-22ced5f334be tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:11.619422 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ea69ab95-4653-4bcf-864c-22ced5f334be tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.268280 May 23 15:33:11.620704 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 243/479] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:11 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:11.739726 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b833da1e-2e46-4864-a216-a04b533c9055 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:11.740422 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b833da1e-2e46-4864-a216-a04b533c9055 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:11.750118 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b833da1e-2e46-4864-a216-a04b533c9055 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:11.751483 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b833da1e-2e46-4864-a216-a04b533c9055 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:11.752347 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b833da1e-2e46-4864-a216-a04b533c9055 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:11.753058 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b833da1e-2e46-4864-a216-a04b533c9055 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:11.968312 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b833da1e-2e46-4864-a216-a04b533c9055 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:11.976071 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b833da1e-2e46-4864-a216-a04b533c9055 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.240351 May 23 15:33:11.976802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 237/480] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:11 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:12.294693 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-bef5840f-22d9-47fd-aff9-125d8d4a71d4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:12.295321 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-bef5840f-22d9-47fd-aff9-125d8d4a71d4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:12.301730 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bef5840f-22d9-47fd-aff9-125d8d4a71d4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:12.302183 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bef5840f-22d9-47fd-aff9-125d8d4a71d4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:12.302966 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bef5840f-22d9-47fd-aff9-125d8d4a71d4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:12.303404 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bef5840f-22d9-47fd-aff9-125d8d4a71d4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:12.443844 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-bef5840f-22d9-47fd-aff9-125d8d4a71d4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:12.455601 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-bef5840f-22d9-47fd-aff9-125d8d4a71d4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1707 microversion: 2.1 time: 0.165392 May 23 15:33:12.456190 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 244/481] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:12 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1707 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:33:12.638607 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b3a4cd00-ead7-47ad-bec7-ce10f9d1c667 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:12.639222 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b3a4cd00-ead7-47ad-bec7-ce10f9d1c667 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:12.646137 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b3a4cd00-ead7-47ad-bec7-ce10f9d1c667 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:12.646589 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b3a4cd00-ead7-47ad-bec7-ce10f9d1c667 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:12.647359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b3a4cd00-ead7-47ad-bec7-ce10f9d1c667 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:12.647801 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b3a4cd00-ead7-47ad-bec7-ce10f9d1c667 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:12.787390 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b3a4cd00-ead7-47ad-bec7-ce10f9d1c667 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:12.797090 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b3a4cd00-ead7-47ad-bec7-ce10f9d1c667 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:12.799018 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b3a4cd00-ead7-47ad-bec7-ce10f9d1c667 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:12.800282 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b3a4cd00-ead7-47ad-bec7-ce10f9d1c667 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.165640 May 23 15:33:12.800902 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 238/482] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:12 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:12.993758 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-bab608ce-abab-4e4b-9a71-4e9b18fe057d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:12.994409 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-bab608ce-abab-4e4b-9a71-4e9b18fe057d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:13.002647 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bab608ce-abab-4e4b-9a71-4e9b18fe057d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:13.003189 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bab608ce-abab-4e4b-9a71-4e9b18fe057d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:13.004050 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bab608ce-abab-4e4b-9a71-4e9b18fe057d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:13.004494 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bab608ce-abab-4e4b-9a71-4e9b18fe057d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:13.143450 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-bab608ce-abab-4e4b-9a71-4e9b18fe057d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:13.151716 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-bab608ce-abab-4e4b-9a71-4e9b18fe057d tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.161183 May 23 15:33:13.152265 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 245/483] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:12 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:13.475050 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-45193637-a83c-4c9f-99dc-37ad7158905c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:13.475761 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-45193637-a83c-4c9f-99dc-37ad7158905c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:13.482071 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-45193637-a83c-4c9f-99dc-37ad7158905c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:13.482604 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-45193637-a83c-4c9f-99dc-37ad7158905c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:13.483458 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-45193637-a83c-4c9f-99dc-37ad7158905c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:13.483969 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-45193637-a83c-4c9f-99dc-37ad7158905c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:13.620681 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-45193637-a83c-4c9f-99dc-37ad7158905c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:13.629885 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-45193637-a83c-4c9f-99dc-37ad7158905c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1707 microversion: 2.1 time: 0.159721 May 23 15:33:13.630680 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 239/484] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:13 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1707 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:13.818299 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-501d3bc9-2c62-415d-a7e8-b009d5b89898 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:13.818916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-501d3bc9-2c62-415d-a7e8-b009d5b89898 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:13.825645 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-501d3bc9-2c62-415d-a7e8-b009d5b89898 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:13.826094 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-501d3bc9-2c62-415d-a7e8-b009d5b89898 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:13.826856 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-501d3bc9-2c62-415d-a7e8-b009d5b89898 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:13.827299 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-501d3bc9-2c62-415d-a7e8-b009d5b89898 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:13.972852 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-501d3bc9-2c62-415d-a7e8-b009d5b89898 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:13.992020 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-501d3bc9-2c62-415d-a7e8-b009d5b89898 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:13.993838 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-501d3bc9-2c62-415d-a7e8-b009d5b89898 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:13.995605 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-501d3bc9-2c62-415d-a7e8-b009d5b89898 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.180826 May 23 15:33:13.996198 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 246/485] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:13 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:14.169298 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-11702cba-e8cb-48d7-8e88-b1cf6c0c5646 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:14.169868 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-11702cba-e8cb-48d7-8e88-b1cf6c0c5646 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:14.176528 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-11702cba-e8cb-48d7-8e88-b1cf6c0c5646 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:14.177024 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-11702cba-e8cb-48d7-8e88-b1cf6c0c5646 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:14.177812 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-11702cba-e8cb-48d7-8e88-b1cf6c0c5646 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:14.178258 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-11702cba-e8cb-48d7-8e88-b1cf6c0c5646 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:14.321762 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-11702cba-e8cb-48d7-8e88-b1cf6c0c5646 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:14.331169 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-11702cba-e8cb-48d7-8e88-b1cf6c0c5646 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.166631 May 23 15:33:14.331935 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 240/486] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:14 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:14.649237 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ddadbbba-4bfc-4450-a705-a7aea024d2e0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:14.649850 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ddadbbba-4bfc-4450-a705-a7aea024d2e0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:14.656734 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ddadbbba-4bfc-4450-a705-a7aea024d2e0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:14.657217 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ddadbbba-4bfc-4450-a705-a7aea024d2e0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:14.657996 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ddadbbba-4bfc-4450-a705-a7aea024d2e0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:14.658432 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ddadbbba-4bfc-4450-a705-a7aea024d2e0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:14.795791 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ddadbbba-4bfc-4450-a705-a7aea024d2e0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:14.804004 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ddadbbba-4bfc-4450-a705-a7aea024d2e0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1707 microversion: 2.1 time: 0.158929 May 23 15:33:14.804768 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 247/487] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:14 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1707 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:15.013846 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1246d52f-5329-41c7-a8a2-6104b0e890e6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:15.014372 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-1246d52f-5329-41c7-a8a2-6104b0e890e6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:15.020604 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1246d52f-5329-41c7-a8a2-6104b0e890e6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:15.021094 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1246d52f-5329-41c7-a8a2-6104b0e890e6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:15.021850 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1246d52f-5329-41c7-a8a2-6104b0e890e6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:15.022287 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1246d52f-5329-41c7-a8a2-6104b0e890e6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:15.161771 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-1246d52f-5329-41c7-a8a2-6104b0e890e6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:15.170023 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-1246d52f-5329-41c7-a8a2-6104b0e890e6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:15.171526 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-1246d52f-5329-41c7-a8a2-6104b0e890e6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:15.172703 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1246d52f-5329-41c7-a8a2-6104b0e890e6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.162935 May 23 15:33:15.173341 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 241/488] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:15 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:15.353490 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-29c32df6-0bdc-4b1d-b700-edd904fc56fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:15.354174 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-29c32df6-0bdc-4b1d-b700-edd904fc56fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:15.360842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-29c32df6-0bdc-4b1d-b700-edd904fc56fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:15.361333 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-29c32df6-0bdc-4b1d-b700-edd904fc56fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:15.362181 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-29c32df6-0bdc-4b1d-b700-edd904fc56fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:15.362630 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-29c32df6-0bdc-4b1d-b700-edd904fc56fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:15.500145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-29c32df6-0bdc-4b1d-b700-edd904fc56fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:15.507837 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-29c32df6-0bdc-4b1d-b700-edd904fc56fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.158528 May 23 15:33:15.508410 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 248/489] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:15 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:15.821844 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-93a9955e-6dd8-4ff4-b9a4-5d3b4d52ccb4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:15.822448 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-93a9955e-6dd8-4ff4-b9a4-5d3b4d52ccb4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:15.831451 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-93a9955e-6dd8-4ff4-b9a4-5d3b4d52ccb4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:15.831939 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-93a9955e-6dd8-4ff4-b9a4-5d3b4d52ccb4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:15.832716 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-93a9955e-6dd8-4ff4-b9a4-5d3b4d52ccb4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:15.833186 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-93a9955e-6dd8-4ff4-b9a4-5d3b4d52ccb4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:15.980420 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-93a9955e-6dd8-4ff4-b9a4-5d3b4d52ccb4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:15.988966 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-93a9955e-6dd8-4ff4-b9a4-5d3b4d52ccb4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1707 microversion: 2.1 time: 0.170890 May 23 15:33:15.989506 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 242/490] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:15 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1707 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:33:16.191168 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-0a3963a9-5564-4226-a28f-0cc4a973a99f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:16.191702 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-0a3963a9-5564-4226-a28f-0cc4a973a99f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:16.198339 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0a3963a9-5564-4226-a28f-0cc4a973a99f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:16.198795 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0a3963a9-5564-4226-a28f-0cc4a973a99f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:16.199559 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0a3963a9-5564-4226-a28f-0cc4a973a99f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:16.200078 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0a3963a9-5564-4226-a28f-0cc4a973a99f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:16.336798 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0a3963a9-5564-4226-a28f-0cc4a973a99f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:16.346783 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0a3963a9-5564-4226-a28f-0cc4a973a99f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:16.348978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0a3963a9-5564-4226-a28f-0cc4a973a99f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:16.349653 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-0a3963a9-5564-4226-a28f-0cc4a973a99f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.162458 May 23 15:33:16.357030 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 249/491] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:16 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:16.524908 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-bec9a530-5dc1-4e5c-8714-3b92296a62be tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:16.525553 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-bec9a530-5dc1-4e5c-8714-3b92296a62be tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:16.531824 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bec9a530-5dc1-4e5c-8714-3b92296a62be tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:16.532281 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bec9a530-5dc1-4e5c-8714-3b92296a62be tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:16.533087 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bec9a530-5dc1-4e5c-8714-3b92296a62be tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:16.533537 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bec9a530-5dc1-4e5c-8714-3b92296a62be tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:16.674935 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-bec9a530-5dc1-4e5c-8714-3b92296a62be tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:16.684369 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-bec9a530-5dc1-4e5c-8714-3b92296a62be tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.162754 May 23 15:33:16.685417 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 243/492] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:16 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:17.008462 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-7f58890e-5344-49d1-88c7-c6540854658e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:17.009420 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-7f58890e-5344-49d1-88c7-c6540854658e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:17.018029 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7f58890e-5344-49d1-88c7-c6540854658e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:17.018488 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7f58890e-5344-49d1-88c7-c6540854658e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:17.019294 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7f58890e-5344-49d1-88c7-c6540854658e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:17.019738 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7f58890e-5344-49d1-88c7-c6540854658e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:17.157361 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-7f58890e-5344-49d1-88c7-c6540854658e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:17.165426 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-7f58890e-5344-49d1-88c7-c6540854658e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1707 microversion: 2.1 time: 0.161609 May 23 15:33:17.165995 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 250/493] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:17 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1707 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:17.369115 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f334221a-949e-43ff-8e97-83f83643d197 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:17.369773 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f334221a-949e-43ff-8e97-83f83643d197 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:17.376341 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f334221a-949e-43ff-8e97-83f83643d197 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:17.376794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f334221a-949e-43ff-8e97-83f83643d197 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:17.377587 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f334221a-949e-43ff-8e97-83f83643d197 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:17.378025 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f334221a-949e-43ff-8e97-83f83643d197 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:17.513288 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f334221a-949e-43ff-8e97-83f83643d197 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:17.521914 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f334221a-949e-43ff-8e97-83f83643d197 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:17.523435 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f334221a-949e-43ff-8e97-83f83643d197 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:17.524594 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f334221a-949e-43ff-8e97-83f83643d197 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.159430 May 23 15:33:17.525203 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 244/494] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:17 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:17.700748 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2afa7929-7145-473a-9b06-27ae7210812b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:17.701380 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-2afa7929-7145-473a-9b06-27ae7210812b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:17.707800 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2afa7929-7145-473a-9b06-27ae7210812b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:17.708245 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2afa7929-7145-473a-9b06-27ae7210812b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:17.709031 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2afa7929-7145-473a-9b06-27ae7210812b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:17.709465 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2afa7929-7145-473a-9b06-27ae7210812b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:17.795346 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f0754c3d-85d4-44f1-ae97-9bcd857420a4 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:17.796406 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f0754c3d-85d4-44f1-ae97-9bcd857420a4 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:17.802583 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f0754c3d-85d4-44f1-ae97-9bcd857420a4 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:17.803039 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f0754c3d-85d4-44f1-ae97-9bcd857420a4 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:17.803812 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f0754c3d-85d4-44f1-ae97-9bcd857420a4 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:17.804255 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f0754c3d-85d4-44f1-ae97-9bcd857420a4 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:17.842148 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-2afa7929-7145-473a-9b06-27ae7210812b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:17.849556 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-2afa7929-7145-473a-9b06-27ae7210812b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.152699 May 23 15:33:17.850118 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 251/495] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:17 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:17.875466 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f0754c3d-85d4-44f1-ae97-9bcd857420a4 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "POST /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/action" status: 202 len: 0 microversion: 2.1 time: 0.084478 May 23 15:33:17.876056 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 245/496] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 15:33:17 2022] POST /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:33:17.884179 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b872ddd8-2f7a-45d7-bcbf-d76fef1e5f7a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:17.884794 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b872ddd8-2f7a-45d7-bcbf-d76fef1e5f7a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:17.891765 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b872ddd8-2f7a-45d7-bcbf-d76fef1e5f7a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:17.892211 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b872ddd8-2f7a-45d7-bcbf-d76fef1e5f7a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:17.893001 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b872ddd8-2f7a-45d7-bcbf-d76fef1e5f7a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:17.893440 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b872ddd8-2f7a-45d7-bcbf-d76fef1e5f7a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:18.042070 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b872ddd8-2f7a-45d7-bcbf-d76fef1e5f7a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:18.051439 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b872ddd8-2f7a-45d7-bcbf-d76fef1e5f7a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1750 microversion: 2.1 time: 0.170946 May 23 15:33:18.052019 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 252/497] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:17 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1750 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:18.185724 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d79e57ff-d84d-4266-ac50-71996cc1ecd1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:18.186378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d79e57ff-d84d-4266-ac50-71996cc1ecd1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:18.192719 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d79e57ff-d84d-4266-ac50-71996cc1ecd1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:18.193351 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d79e57ff-d84d-4266-ac50-71996cc1ecd1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:18.193993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d79e57ff-d84d-4266-ac50-71996cc1ecd1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:18.194430 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d79e57ff-d84d-4266-ac50-71996cc1ecd1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:18.328204 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d79e57ff-d84d-4266-ac50-71996cc1ecd1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:18.336416 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d79e57ff-d84d-4266-ac50-71996cc1ecd1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1711 microversion: 2.1 time: 0.155960 May 23 15:33:18.337016 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 246/498] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:18 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1711 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:18.544398 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-9b9e7e12-d686-41c5-ac68-110fcf239357 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:18.545042 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-9b9e7e12-d686-41c5-ac68-110fcf239357 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:18.551159 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9b9e7e12-d686-41c5-ac68-110fcf239357 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:18.551607 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9b9e7e12-d686-41c5-ac68-110fcf239357 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:18.552377 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9b9e7e12-d686-41c5-ac68-110fcf239357 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:18.552816 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9b9e7e12-d686-41c5-ac68-110fcf239357 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:18.556782 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=100 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:18.682548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9b9e7e12-d686-41c5-ac68-110fcf239357 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:18.691082 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9b9e7e12-d686-41c5-ac68-110fcf239357 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:18.692604 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9b9e7e12-d686-41c5-ac68-110fcf239357 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:18.693828 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-9b9e7e12-d686-41c5-ac68-110fcf239357 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.153950 May 23 15:33:18.694392 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 253/499] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:18 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:18.867271 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7d6c14d2-bfa5-4a10-bc37-5c87f231f6a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:18.867883 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7d6c14d2-bfa5-4a10-bc37-5c87f231f6a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:18.874538 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7d6c14d2-bfa5-4a10-bc37-5c87f231f6a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:18.874991 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7d6c14d2-bfa5-4a10-bc37-5c87f231f6a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:18.875758 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7d6c14d2-bfa5-4a10-bc37-5c87f231f6a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:18.876200 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7d6c14d2-bfa5-4a10-bc37-5c87f231f6a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:18.878845 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:19.006830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-7d6c14d2-bfa5-4a10-bc37-5c87f231f6a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:19.014235 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7d6c14d2-bfa5-4a10-bc37-5c87f231f6a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.150820 May 23 15:33:19.015057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 247/500] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:18 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:19.069248 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d1a3f0d9-ecf1-47c3-a31a-a4949248c758 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:19.069852 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d1a3f0d9-ecf1-47c3-a31a-a4949248c758 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:19.076511 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d1a3f0d9-ecf1-47c3-a31a-a4949248c758 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:19.076919 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d1a3f0d9-ecf1-47c3-a31a-a4949248c758 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:19.077678 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d1a3f0d9-ecf1-47c3-a31a-a4949248c758 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:19.078109 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d1a3f0d9-ecf1-47c3-a31a-a4949248c758 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:19.215516 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d1a3f0d9-ecf1-47c3-a31a-a4949248c758 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:19.223341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d1a3f0d9-ecf1-47c3-a31a-a4949248c758 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1750 microversion: 2.1 time: 0.157876 May 23 15:33:19.223899 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 254/501] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:19 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:19.712621 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ae926927-a00a-4c59-bc2a-168d6997aa5d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:19.713270 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ae926927-a00a-4c59-bc2a-168d6997aa5d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:19.720034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ae926927-a00a-4c59-bc2a-168d6997aa5d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:19.720417 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ae926927-a00a-4c59-bc2a-168d6997aa5d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:19.721210 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ae926927-a00a-4c59-bc2a-168d6997aa5d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:19.721645 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ae926927-a00a-4c59-bc2a-168d6997aa5d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:19.847140 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ae926927-a00a-4c59-bc2a-168d6997aa5d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:19.855587 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ae926927-a00a-4c59-bc2a-168d6997aa5d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:19.857130 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ae926927-a00a-4c59-bc2a-168d6997aa5d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:19.858294 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ae926927-a00a-4c59-bc2a-168d6997aa5d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.149653 May 23 15:33:19.859059 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 248/502] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:19 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:20.031271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c3f60e59-8f11-495b-8b46-b78ebd898b03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:20.031910 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-c3f60e59-8f11-495b-8b46-b78ebd898b03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:20.038065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c3f60e59-8f11-495b-8b46-b78ebd898b03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:20.038514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c3f60e59-8f11-495b-8b46-b78ebd898b03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:20.039269 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c3f60e59-8f11-495b-8b46-b78ebd898b03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:20.039702 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c3f60e59-8f11-495b-8b46-b78ebd898b03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:20.165020 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c3f60e59-8f11-495b-8b46-b78ebd898b03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:20.173180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-c3f60e59-8f11-495b-8b46-b78ebd898b03 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.145787 May 23 15:33:20.173748 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 255/503] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:20 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:20.241517 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-950ccda2-1860-404b-a6ba-0407cac81bd6 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:20.242102 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-950ccda2-1860-404b-a6ba-0407cac81bd6 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:20.249597 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-950ccda2-1860-404b-a6ba-0407cac81bd6 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:20.250064 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-950ccda2-1860-404b-a6ba-0407cac81bd6 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:20.250836 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-950ccda2-1860-404b-a6ba-0407cac81bd6 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:20.251282 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-950ccda2-1860-404b-a6ba-0407cac81bd6 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:20.393189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-950ccda2-1860-404b-a6ba-0407cac81bd6 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:20.401088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-950ccda2-1860-404b-a6ba-0407cac81bd6 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1750 microversion: 2.1 time: 0.163465 May 23 15:33:20.401659 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 249/504] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:20 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:20.875409 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-6c9360bd-c8ec-404e-a54a-a5ee64bb152e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:20.876047 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-6c9360bd-c8ec-404e-a54a-a5ee64bb152e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:20.882014 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6c9360bd-c8ec-404e-a54a-a5ee64bb152e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:20.882472 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6c9360bd-c8ec-404e-a54a-a5ee64bb152e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:20.883232 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6c9360bd-c8ec-404e-a54a-a5ee64bb152e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:20.883669 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6c9360bd-c8ec-404e-a54a-a5ee64bb152e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:21.015725 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-6c9360bd-c8ec-404e-a54a-a5ee64bb152e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:21.024211 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-6c9360bd-c8ec-404e-a54a-a5ee64bb152e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:21.025700 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-6c9360bd-c8ec-404e-a54a-a5ee64bb152e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:21.027745 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-6c9360bd-c8ec-404e-a54a-a5ee64bb152e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.156199 May 23 15:33:21.028321 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 256/505] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:20 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:21.190434 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-88e50a12-0659-4dbe-9f24-4c53bce00041 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:21.191188 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-88e50a12-0659-4dbe-9f24-4c53bce00041 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:21.197369 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-88e50a12-0659-4dbe-9f24-4c53bce00041 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:21.198353 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-88e50a12-0659-4dbe-9f24-4c53bce00041 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:21.199233 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-88e50a12-0659-4dbe-9f24-4c53bce00041 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:21.199674 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-88e50a12-0659-4dbe-9f24-4c53bce00041 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:21.337769 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-88e50a12-0659-4dbe-9f24-4c53bce00041 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:21.345392 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-88e50a12-0659-4dbe-9f24-4c53bce00041 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1370 microversion: 2.1 time: 0.158777 May 23 15:33:21.345959 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 250/506] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:21 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:21.417854 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-29f5cf8d-527b-4cd4-b92f-f3860d487189 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:21.418467 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-29f5cf8d-527b-4cd4-b92f-f3860d487189 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:21.424804 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-29f5cf8d-527b-4cd4-b92f-f3860d487189 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:21.425282 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-29f5cf8d-527b-4cd4-b92f-f3860d487189 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:21.426040 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-29f5cf8d-527b-4cd4-b92f-f3860d487189 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:21.426471 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-29f5cf8d-527b-4cd4-b92f-f3860d487189 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:21.659973 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-29f5cf8d-527b-4cd4-b92f-f3860d487189 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:21.669157 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-29f5cf8d-527b-4cd4-b92f-f3860d487189 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1750 microversion: 2.1 time: 0.255071 May 23 15:33:21.669972 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 257/507] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:21 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1750 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:22.046027 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-056cb3e5-d25b-4e80-a378-789359bf60fc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:22.046647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-056cb3e5-d25b-4e80-a378-789359bf60fc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:22.052696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-056cb3e5-d25b-4e80-a378-789359bf60fc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:22.053113 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-056cb3e5-d25b-4e80-a378-789359bf60fc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:22.053870 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-056cb3e5-d25b-4e80-a378-789359bf60fc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:22.054310 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-056cb3e5-d25b-4e80-a378-789359bf60fc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:22.187901 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-056cb3e5-d25b-4e80-a378-789359bf60fc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:22.196298 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-056cb3e5-d25b-4e80-a378-789359bf60fc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:22.197875 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-056cb3e5-d25b-4e80-a378-789359bf60fc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:22.199570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-056cb3e5-d25b-4e80-a378-789359bf60fc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.157776 May 23 15:33:22.200130 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 251/508] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:22 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:22.362019 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e9d72376-987f-4876-9739-cc3280c23341 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:22.362555 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e9d72376-987f-4876-9739-cc3280c23341 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:22.368536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e9d72376-987f-4876-9739-cc3280c23341 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:22.369021 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e9d72376-987f-4876-9739-cc3280c23341 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:22.370327 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e9d72376-987f-4876-9739-cc3280c23341 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:22.370931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e9d72376-987f-4876-9739-cc3280c23341 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:22.505403 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e9d72376-987f-4876-9739-cc3280c23341 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:22.513117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e9d72376-987f-4876-9739-cc3280c23341 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1564 microversion: 2.1 time: 0.155085 May 23 15:33:22.513676 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 258/509] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:22 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:22.529504 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-567b6722-ffc7-41ab-9889-f43e3595b2dc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:22.529998 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-567b6722-ffc7-41ab-9889-f43e3595b2dc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:22.536453 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-567b6722-ffc7-41ab-9889-f43e3595b2dc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:22.536939 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-567b6722-ffc7-41ab-9889-f43e3595b2dc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:22.537708 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-567b6722-ffc7-41ab-9889-f43e3595b2dc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:22.538151 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-567b6722-ffc7-41ab-9889-f43e3595b2dc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:22.615001 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-567b6722-ffc7-41ab-9889-f43e3595b2dc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089323 May 23 15:33:22.615613 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 252/510] 10.222.0.30 () {58 vars in 1274 bytes} [Mon May 23 15:33:22 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:22.687287 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-854aa94e-3949-4e1b-8a28-f78bb1d693ba tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:22.687903 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-854aa94e-3949-4e1b-8a28-f78bb1d693ba tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:22.693893 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-854aa94e-3949-4e1b-8a28-f78bb1d693ba tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:22.694339 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-854aa94e-3949-4e1b-8a28-f78bb1d693ba tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:22.695101 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-854aa94e-3949-4e1b-8a28-f78bb1d693ba tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:22.695536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-854aa94e-3949-4e1b-8a28-f78bb1d693ba tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:22.836072 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-854aa94e-3949-4e1b-8a28-f78bb1d693ba tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:22.844186 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-854aa94e-3949-4e1b-8a28-f78bb1d693ba tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.160797 May 23 15:33:22.854331 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 259/511] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:22 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:23.217761 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-78c53e79-e4ad-4fd6-b6bb-ba8203b09f8e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:23.218403 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-78c53e79-e4ad-4fd6-b6bb-ba8203b09f8e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:23.224555 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-78c53e79-e4ad-4fd6-b6bb-ba8203b09f8e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:23.225047 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-78c53e79-e4ad-4fd6-b6bb-ba8203b09f8e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:23.225823 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-78c53e79-e4ad-4fd6-b6bb-ba8203b09f8e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:23.226270 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-78c53e79-e4ad-4fd6-b6bb-ba8203b09f8e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:23.448082 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-78c53e79-e4ad-4fd6-b6bb-ba8203b09f8e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:23.456740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-78c53e79-e4ad-4fd6-b6bb-ba8203b09f8e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:23.458277 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-78c53e79-e4ad-4fd6-b6bb-ba8203b09f8e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:23.459439 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-78c53e79-e4ad-4fd6-b6bb-ba8203b09f8e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.245754 May 23 15:33:23.459990 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 253/512] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:23 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:23.610306 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-ef1bf655-7989-45a6-8ba0-d41398ac39d9 req-99b32da3-175f-4121-9877-35f4b6dc342a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb26539d-bd10-48dd-9c5d-433060babfb6", "tag": "e105091f-4632-47d3-b731-412205a70375"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:23.619100 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-ef1bf655-7989-45a6-8ba0-d41398ac39d9 req-99b32da3-175f-4121-9877-35f4b6dc342a service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:23.619651 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-ef1bf655-7989-45a6-8ba0-d41398ac39d9 req-99b32da3-175f-4121-9877-35f4b6dc342a service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:23.631241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-ef1bf655-7989-45a6-8ba0-d41398ac39d9 req-99b32da3-175f-4121-9877-35f4b6dc342a service nova] Creating event network-changed:e105091f-4632-47d3-b731-412205a70375 for instance bb26539d-bd10-48dd-9c5d-433060babfb6 on hv-cinder-84112 May 23 15:33:23.636473 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-ef1bf655-7989-45a6-8ba0-d41398ac39d9 req-99b32da3-175f-4121-9877-35f4b6dc342a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029833 May 23 15:33:23.637263 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 260/513] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:23.861946 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b4ca1c38-2547-4919-bd86-1b98b3a4f876 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:23.862558 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b4ca1c38-2547-4919-bd86-1b98b3a4f876 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:23.869732 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b4ca1c38-2547-4919-bd86-1b98b3a4f876 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:23.870333 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b4ca1c38-2547-4919-bd86-1b98b3a4f876 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:23.871219 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b4ca1c38-2547-4919-bd86-1b98b3a4f876 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:23.871927 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b4ca1c38-2547-4919-bd86-1b98b3a4f876 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:24.022032 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b4ca1c38-2547-4919-bd86-1b98b3a4f876 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:24.030739 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b4ca1c38-2547-4919-bd86-1b98b3a4f876 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.172559 May 23 15:33:24.031338 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 254/514] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:23 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:24.478953 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-bdad010c-e97c-44c2-be85-67f4c19cfca9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:24.480464 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-bdad010c-e97c-44c2-be85-67f4c19cfca9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:24.486721 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bdad010c-e97c-44c2-be85-67f4c19cfca9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:24.487173 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bdad010c-e97c-44c2-be85-67f4c19cfca9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:24.487949 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bdad010c-e97c-44c2-be85-67f4c19cfca9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:24.488390 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bdad010c-e97c-44c2-be85-67f4c19cfca9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:24.630722 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-bdad010c-e97c-44c2-be85-67f4c19cfca9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:24.639789 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-bdad010c-e97c-44c2-be85-67f4c19cfca9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:24.641578 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-bdad010c-e97c-44c2-be85-67f4c19cfca9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:24.642743 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-bdad010c-e97c-44c2-be85-67f4c19cfca9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.168604 May 23 15:33:24.643295 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 261/515] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:24 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:25.050890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-6dd55fd9-c23f-4631-8b83-86aeca0157fb tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:25.051503 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-6dd55fd9-c23f-4631-8b83-86aeca0157fb tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:25.058459 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6dd55fd9-c23f-4631-8b83-86aeca0157fb tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:25.058907 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6dd55fd9-c23f-4631-8b83-86aeca0157fb tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:25.059668 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6dd55fd9-c23f-4631-8b83-86aeca0157fb tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:25.060105 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6dd55fd9-c23f-4631-8b83-86aeca0157fb tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:25.203324 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-6dd55fd9-c23f-4631-8b83-86aeca0157fb tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:25.211216 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-6dd55fd9-c23f-4631-8b83-86aeca0157fb tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.164207 May 23 15:33:25.211779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 255/516] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:25 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:25.661245 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-7691d9c0-ae30-401f-98d3-6371992d5d02 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:25.661863 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-7691d9c0-ae30-401f-98d3-6371992d5d02 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:25.668585 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7691d9c0-ae30-401f-98d3-6371992d5d02 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:25.669082 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7691d9c0-ae30-401f-98d3-6371992d5d02 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:25.669852 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7691d9c0-ae30-401f-98d3-6371992d5d02 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:25.670296 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7691d9c0-ae30-401f-98d3-6371992d5d02 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:25.799422 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-7691d9c0-ae30-401f-98d3-6371992d5d02 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:25.808333 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-7691d9c0-ae30-401f-98d3-6371992d5d02 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:25.809867 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-7691d9c0-ae30-401f-98d3-6371992d5d02 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:25.811033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-7691d9c0-ae30-401f-98d3-6371992d5d02 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.153699 May 23 15:33:25.811589 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 262/517] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:25 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:26.228595 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-19a4657d-2601-4ede-a4cc-cb688d8dbec3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:26.229315 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-19a4657d-2601-4ede-a4cc-cb688d8dbec3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:26.232036 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=80 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:26.237620 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-19a4657d-2601-4ede-a4cc-cb688d8dbec3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:26.238077 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-19a4657d-2601-4ede-a4cc-cb688d8dbec3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:26.238847 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-19a4657d-2601-4ede-a4cc-cb688d8dbec3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:26.239288 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-19a4657d-2601-4ede-a4cc-cb688d8dbec3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:26.377752 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-19a4657d-2601-4ede-a4cc-cb688d8dbec3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:26.386317 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-19a4657d-2601-4ede-a4cc-cb688d8dbec3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.160899 May 23 15:33:26.387040 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 256/518] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:26 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:26.829643 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-0fb575bc-16ac-4354-9473-380e2efeed48 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:26.830214 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-0fb575bc-16ac-4354-9473-380e2efeed48 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:26.836753 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fb575bc-16ac-4354-9473-380e2efeed48 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:26.837239 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fb575bc-16ac-4354-9473-380e2efeed48 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:26.838010 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fb575bc-16ac-4354-9473-380e2efeed48 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:26.838458 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fb575bc-16ac-4354-9473-380e2efeed48 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:26.965338 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0fb575bc-16ac-4354-9473-380e2efeed48 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:26.973801 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0fb575bc-16ac-4354-9473-380e2efeed48 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:26.975309 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0fb575bc-16ac-4354-9473-380e2efeed48 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:26.976475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-0fb575bc-16ac-4354-9473-380e2efeed48 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.151089 May 23 15:33:26.977073 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 263/519] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:26 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:27.404193 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ee26db1f-8cd1-46b2-b47a-3ea7f60676bc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:27.404809 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ee26db1f-8cd1-46b2-b47a-3ea7f60676bc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:27.411324 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ee26db1f-8cd1-46b2-b47a-3ea7f60676bc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:27.411780 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ee26db1f-8cd1-46b2-b47a-3ea7f60676bc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:27.412546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ee26db1f-8cd1-46b2-b47a-3ea7f60676bc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:27.413014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ee26db1f-8cd1-46b2-b47a-3ea7f60676bc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:27.558205 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ee26db1f-8cd1-46b2-b47a-3ea7f60676bc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:27.566155 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ee26db1f-8cd1-46b2-b47a-3ea7f60676bc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.166471 May 23 15:33:27.566727 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 257/520] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:27 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:27.994938 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-666b1d15-7883-4846-9643-287e89495b85 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:27.995579 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-666b1d15-7883-4846-9643-287e89495b85 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:28.001960 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-666b1d15-7883-4846-9643-287e89495b85 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:28.002414 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-666b1d15-7883-4846-9643-287e89495b85 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:28.003211 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-666b1d15-7883-4846-9643-287e89495b85 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:28.003655 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-666b1d15-7883-4846-9643-287e89495b85 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:28.137206 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-666b1d15-7883-4846-9643-287e89495b85 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:28.146225 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-666b1d15-7883-4846-9643-287e89495b85 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:28.147731 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-666b1d15-7883-4846-9643-287e89495b85 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:28.148925 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-666b1d15-7883-4846-9643-287e89495b85 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.158177 May 23 15:33:28.149483 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 264/521] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:27 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:28.583376 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b3ec6b67-e1e1-47f9-a774-541c1cb4dc0b tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:28.583987 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b3ec6b67-e1e1-47f9-a774-541c1cb4dc0b tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:28.591350 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b3ec6b67-e1e1-47f9-a774-541c1cb4dc0b tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:28.591800 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b3ec6b67-e1e1-47f9-a774-541c1cb4dc0b tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:28.592568 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b3ec6b67-e1e1-47f9-a774-541c1cb4dc0b tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:28.593041 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b3ec6b67-e1e1-47f9-a774-541c1cb4dc0b tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:28.734066 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b3ec6b67-e1e1-47f9-a774-541c1cb4dc0b tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:28.742010 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b3ec6b67-e1e1-47f9-a774-541c1cb4dc0b tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.162507 May 23 15:33:28.742570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 258/522] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:28 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:29.168093 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-eafa8de6-8514-4d37-9b07-5bdb5510d416 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:29.168706 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-eafa8de6-8514-4d37-9b07-5bdb5510d416 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:29.175217 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eafa8de6-8514-4d37-9b07-5bdb5510d416 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:29.175668 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eafa8de6-8514-4d37-9b07-5bdb5510d416 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:29.176431 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eafa8de6-8514-4d37-9b07-5bdb5510d416 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:29.176887 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eafa8de6-8514-4d37-9b07-5bdb5510d416 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:29.303494 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-eafa8de6-8514-4d37-9b07-5bdb5510d416 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:29.313121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-eafa8de6-8514-4d37-9b07-5bdb5510d416 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:29.314670 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-eafa8de6-8514-4d37-9b07-5bdb5510d416 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:29.315856 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-eafa8de6-8514-4d37-9b07-5bdb5510d416 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.152399 May 23 15:33:29.316412 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 265/523] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:29 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:29.607850 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-bd59e74a-18cb-4826-a30f-da04171ea238 req-bd1b578c-3a6f-4032-9975-77836f8a946b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9038c8-1395-4d48-b10b-2fe7310c4c76", "name": "network-vif-plugged", "status": "completed", "tag": "920328ed-01fa-4ed4-b496-7b1fea54b54c"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:29.616798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-bd59e74a-18cb-4826-a30f-da04171ea238 req-bd1b578c-3a6f-4032-9975-77836f8a946b service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:29.617675 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-bd59e74a-18cb-4826-a30f-da04171ea238 req-bd1b578c-3a6f-4032-9975-77836f8a946b service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:29.630578 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-bd59e74a-18cb-4826-a30f-da04171ea238 req-bd1b578c-3a6f-4032-9975-77836f8a946b service nova] Creating event network-vif-plugged:920328ed-01fa-4ed4-b496-7b1fea54b54c for instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 on hv-cinder-84112 May 23 15:33:29.636002 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-bd59e74a-18cb-4826-a30f-da04171ea238 req-bd1b578c-3a6f-4032-9975-77836f8a946b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032609 May 23 15:33:29.636708 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 259/524] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:29.760004 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-07a268b1-1880-43bb-8452-8a663c8aeee4 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:29.760927 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-07a268b1-1880-43bb-8452-8a663c8aeee4 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:29.772267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-07a268b1-1880-43bb-8452-8a663c8aeee4 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:29.773087 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-07a268b1-1880-43bb-8452-8a663c8aeee4 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:29.774442 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-07a268b1-1880-43bb-8452-8a663c8aeee4 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:29.775035 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-07a268b1-1880-43bb-8452-8a663c8aeee4 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:29.929564 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-07a268b1-1880-43bb-8452-8a663c8aeee4 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:29.937665 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-07a268b1-1880-43bb-8452-8a663c8aeee4 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.181792 May 23 15:33:29.938237 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 266/525] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:29 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:33:30.334356 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b0963d36-5c5d-42a1-ae91-b45628900319 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:30.335061 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b0963d36-5c5d-42a1-ae91-b45628900319 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:30.341372 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b0963d36-5c5d-42a1-ae91-b45628900319 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:30.341823 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b0963d36-5c5d-42a1-ae91-b45628900319 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:30.342584 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b0963d36-5c5d-42a1-ae91-b45628900319 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:30.343031 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b0963d36-5c5d-42a1-ae91-b45628900319 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:30.474466 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b0963d36-5c5d-42a1-ae91-b45628900319 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:30.482998 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b0963d36-5c5d-42a1-ae91-b45628900319 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:30.484507 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b0963d36-5c5d-42a1-ae91-b45628900319 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:30.485700 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b0963d36-5c5d-42a1-ae91-b45628900319 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.155643 May 23 15:33:30.486265 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 260/526] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:30 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:30.954955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b1a1fd9a-8d15-43f8-a512-bbe90e5b82e3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:30.955493 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b1a1fd9a-8d15-43f8-a512-bbe90e5b82e3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:30.961967 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b1a1fd9a-8d15-43f8-a512-bbe90e5b82e3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:30.962423 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b1a1fd9a-8d15-43f8-a512-bbe90e5b82e3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:30.963180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b1a1fd9a-8d15-43f8-a512-bbe90e5b82e3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:30.964371 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b1a1fd9a-8d15-43f8-a512-bbe90e5b82e3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:31.103806 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b1a1fd9a-8d15-43f8-a512-bbe90e5b82e3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:31.111720 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b1a1fd9a-8d15-43f8-a512-bbe90e5b82e3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.160646 May 23 15:33:31.112291 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 267/527] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:30 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:31.504846 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-e24d8813-0d11-492f-9617-e903d1f372ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:31.505538 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-e24d8813-0d11-492f-9617-e903d1f372ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:31.512706 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e24d8813-0d11-492f-9617-e903d1f372ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:31.513183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e24d8813-0d11-492f-9617-e903d1f372ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:31.513969 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e24d8813-0d11-492f-9617-e903d1f372ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:31.514417 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e24d8813-0d11-492f-9617-e903d1f372ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:31.650602 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-e24d8813-0d11-492f-9617-e903d1f372ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:31.661128 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-e24d8813-0d11-492f-9617-e903d1f372ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:31.662646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-e24d8813-0d11-492f-9617-e903d1f372ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:31.663819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-e24d8813-0d11-492f-9617-e903d1f372ab tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1809 microversion: 2.20 time: 0.162941 May 23 15:33:31.664454 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 261/528] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:31 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:32.129489 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-1de24209-8529-420a-984f-e0a5bdda3c5a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:32.130056 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-1de24209-8529-420a-984f-e0a5bdda3c5a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:32.137252 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1de24209-8529-420a-984f-e0a5bdda3c5a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:32.137708 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1de24209-8529-420a-984f-e0a5bdda3c5a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:32.138523 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1de24209-8529-420a-984f-e0a5bdda3c5a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:32.138969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1de24209-8529-420a-984f-e0a5bdda3c5a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:32.285729 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1de24209-8529-420a-984f-e0a5bdda3c5a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:32.294289 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-1de24209-8529-420a-984f-e0a5bdda3c5a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.168797 May 23 15:33:32.294858 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 268/529] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:32 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:32.681187 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-97fc622f-344e-4d1a-9be2-6cb7b4efaff1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:32.681909 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-97fc622f-344e-4d1a-9be2-6cb7b4efaff1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:32.688330 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-97fc622f-344e-4d1a-9be2-6cb7b4efaff1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:32.688774 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-97fc622f-344e-4d1a-9be2-6cb7b4efaff1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:32.689632 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-97fc622f-344e-4d1a-9be2-6cb7b4efaff1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:32.690067 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-97fc622f-344e-4d1a-9be2-6cb7b4efaff1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:32.815504 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-97fc622f-344e-4d1a-9be2-6cb7b4efaff1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:32.823903 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-97fc622f-344e-4d1a-9be2-6cb7b4efaff1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:32.825432 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-97fc622f-344e-4d1a-9be2-6cb7b4efaff1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:32.826587 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-97fc622f-344e-4d1a-9be2-6cb7b4efaff1 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1796 microversion: 2.20 time: 0.149307 May 23 15:33:32.827143 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 262/530] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:33:32 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1796 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:33:33.311841 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-19a803fe-57c6-426b-9b99-674ab78cdc8a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:33.312457 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-19a803fe-57c6-426b-9b99-674ab78cdc8a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:33.318571 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-19a803fe-57c6-426b-9b99-674ab78cdc8a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:33.319016 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-19a803fe-57c6-426b-9b99-674ab78cdc8a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:33.319771 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-19a803fe-57c6-426b-9b99-674ab78cdc8a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:33.320206 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-19a803fe-57c6-426b-9b99-674ab78cdc8a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:33.465375 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-19a803fe-57c6-426b-9b99-674ab78cdc8a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:33.473381 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-19a803fe-57c6-426b-9b99-674ab78cdc8a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.166055 May 23 15:33:33.473957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 269/531] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:33 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:34.490257 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-076d1d46-11b4-4548-84ce-41d88b4a41ed tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:34.490875 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-076d1d46-11b4-4548-84ce-41d88b4a41ed tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:34.498220 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-076d1d46-11b4-4548-84ce-41d88b4a41ed tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:34.498674 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-076d1d46-11b4-4548-84ce-41d88b4a41ed tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:34.499448 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-076d1d46-11b4-4548-84ce-41d88b4a41ed tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:34.499895 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-076d1d46-11b4-4548-84ce-41d88b4a41ed tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:34.643864 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-076d1d46-11b4-4548-84ce-41d88b4a41ed tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:34.651781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-076d1d46-11b4-4548-84ce-41d88b4a41ed tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.165442 May 23 15:33:34.652342 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 263/532] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:34 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:35.669027 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-140889c9-09bd-494d-b35f-87f773fb5125 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:35.669642 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-140889c9-09bd-494d-b35f-87f773fb5125 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:35.676172 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-140889c9-09bd-494d-b35f-87f773fb5125 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:35.676648 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-140889c9-09bd-494d-b35f-87f773fb5125 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:35.677471 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-140889c9-09bd-494d-b35f-87f773fb5125 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:35.677915 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-140889c9-09bd-494d-b35f-87f773fb5125 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:35.692545 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=100 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:35.821996 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-140889c9-09bd-494d-b35f-87f773fb5125 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:35.830022 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-140889c9-09bd-494d-b35f-87f773fb5125 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.165470 May 23 15:33:35.830583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 270/533] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:35 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:36.847448 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1b7461a1-bce2-42e6-b399-696e2483e334 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:36.848092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-1b7461a1-bce2-42e6-b399-696e2483e334 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:36.855181 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1b7461a1-bce2-42e6-b399-696e2483e334 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:36.855499 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1b7461a1-bce2-42e6-b399-696e2483e334 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:36.856296 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1b7461a1-bce2-42e6-b399-696e2483e334 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:36.856742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1b7461a1-bce2-42e6-b399-696e2483e334 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:37.000104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-1b7461a1-bce2-42e6-b399-696e2483e334 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:37.002504 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=100 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:37.009566 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1b7461a1-bce2-42e6-b399-696e2483e334 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.165936 May 23 15:33:37.010143 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 264/534] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:36 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:38.028348 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-975afb0d-8c9c-4ba5-81dd-d90be058f755 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:38.028997 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-975afb0d-8c9c-4ba5-81dd-d90be058f755 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:38.030805 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=72 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:38.037568 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-975afb0d-8c9c-4ba5-81dd-d90be058f755 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:38.038020 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-975afb0d-8c9c-4ba5-81dd-d90be058f755 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:38.038880 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-975afb0d-8c9c-4ba5-81dd-d90be058f755 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:38.039327 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-975afb0d-8c9c-4ba5-81dd-d90be058f755 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:38.185638 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-975afb0d-8c9c-4ba5-81dd-d90be058f755 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:38.193631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-975afb0d-8c9c-4ba5-81dd-d90be058f755 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.170231 May 23 15:33:38.194217 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 271/535] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:38 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:39.210930 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b55cfbf1-7c04-4e5d-b7c6-51a61a42f8f8 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:39.211540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b55cfbf1-7c04-4e5d-b7c6-51a61a42f8f8 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:39.218315 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b55cfbf1-7c04-4e5d-b7c6-51a61a42f8f8 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:39.218765 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b55cfbf1-7c04-4e5d-b7c6-51a61a42f8f8 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:39.219519 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b55cfbf1-7c04-4e5d-b7c6-51a61a42f8f8 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:39.219952 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b55cfbf1-7c04-4e5d-b7c6-51a61a42f8f8 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:39.363982 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b55cfbf1-7c04-4e5d-b7c6-51a61a42f8f8 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:39.371875 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b55cfbf1-7c04-4e5d-b7c6-51a61a42f8f8 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.164747 May 23 15:33:39.372431 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 265/536] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:39 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:40.389718 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e28d5ed3-82cc-4c85-a72e-bc945ae6cd73 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:40.390364 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e28d5ed3-82cc-4c85-a72e-bc945ae6cd73 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:40.397114 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e28d5ed3-82cc-4c85-a72e-bc945ae6cd73 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:40.397561 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e28d5ed3-82cc-4c85-a72e-bc945ae6cd73 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:40.398323 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e28d5ed3-82cc-4c85-a72e-bc945ae6cd73 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:40.398757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e28d5ed3-82cc-4c85-a72e-bc945ae6cd73 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:40.536170 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e28d5ed3-82cc-4c85-a72e-bc945ae6cd73 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:40.544312 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e28d5ed3-82cc-4c85-a72e-bc945ae6cd73 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.158939 May 23 15:33:40.544913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 272/537] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:40 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:41.560670 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-12bc8359-ee6a-400d-8ddc-002e0c2c1fe0 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:41.561248 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-12bc8359-ee6a-400d-8ddc-002e0c2c1fe0 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:41.567842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-12bc8359-ee6a-400d-8ddc-002e0c2c1fe0 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:41.568296 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-12bc8359-ee6a-400d-8ddc-002e0c2c1fe0 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:41.569127 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-12bc8359-ee6a-400d-8ddc-002e0c2c1fe0 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:41.569567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-12bc8359-ee6a-400d-8ddc-002e0c2c1fe0 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:41.710517 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-12bc8359-ee6a-400d-8ddc-002e0c2c1fe0 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:41.718452 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-12bc8359-ee6a-400d-8ddc-002e0c2c1fe0 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.161993 May 23 15:33:41.719117 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 266/538] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:41 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:42.736199 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-99f4d74e-f84c-4978-a9f3-9bff09fba3bc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:42.736821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-99f4d74e-f84c-4978-a9f3-9bff09fba3bc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:42.749360 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-99f4d74e-f84c-4978-a9f3-9bff09fba3bc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:42.749824 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-99f4d74e-f84c-4978-a9f3-9bff09fba3bc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:42.750597 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-99f4d74e-f84c-4978-a9f3-9bff09fba3bc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:42.751031 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-99f4d74e-f84c-4978-a9f3-9bff09fba3bc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:42.899725 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-99f4d74e-f84c-4978-a9f3-9bff09fba3bc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:42.908347 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-99f4d74e-f84c-4978-a9f3-9bff09fba3bc tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1755 microversion: 2.1 time: 0.175997 May 23 15:33:42.908929 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 273/539] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:42 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:43.925602 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-63cca580-f0ec-423e-a9cb-9fa4ed437b29 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:43.926261 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-63cca580-f0ec-423e-a9cb-9fa4ed437b29 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:43.933210 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-63cca580-f0ec-423e-a9cb-9fa4ed437b29 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:43.933697 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-63cca580-f0ec-423e-a9cb-9fa4ed437b29 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:43.934986 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-63cca580-f0ec-423e-a9cb-9fa4ed437b29 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:43.935446 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-63cca580-f0ec-423e-a9cb-9fa4ed437b29 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:44.084195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-63cca580-f0ec-423e-a9cb-9fa4ed437b29 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:44.092588 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-63cca580-f0ec-423e-a9cb-9fa4ed437b29 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1758 microversion: 2.1 time: 0.171120 May 23 15:33:44.093181 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 267/540] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:43 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:50.482436 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-bbf7a7c0-29e5-48cb-a571-cdb111750182 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:50.483215 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-bbf7a7c0-29e5-48cb-a571-cdb111750182 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:50.490044 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bbf7a7c0-29e5-48cb-a571-cdb111750182 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:50.490504 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bbf7a7c0-29e5-48cb-a571-cdb111750182 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:50.491278 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bbf7a7c0-29e5-48cb-a571-cdb111750182 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:50.491720 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bbf7a7c0-29e5-48cb-a571-cdb111750182 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:50.515814 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-bbf7a7c0-29e5-48cb-a571-cdb111750182 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0/ips" status: 200 len: 148 microversion: 2.1 time: 0.037781 May 23 15:33:50.516642 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 274/541] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 15:33:50 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:50.527160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-681ea0a9-6e75-4818-a566-75b670b88d66 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ece2194-5ae3-41dd-8093-100a4148172a"}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:50.528251 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-681ea0a9-6e75-4818-a566-75b670b88d66 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:50.535794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-681ea0a9-6e75-4818-a566-75b670b88d66 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:50.536367 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-681ea0a9-6e75-4818-a566-75b670b88d66 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:50.537263 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-681ea0a9-6e75-4818-a566-75b670b88d66 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:50.537718 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-681ea0a9-6e75-4818-a566-75b670b88d66 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:50.617739 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-681ea0a9-6e75-4818-a566-75b670b88d66 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] HTTP exception thrown: Invalid volume: volume 7ece2194-5ae3-41dd-8093-100a4148172a is already attached to instances: e30f7223-50a4-46a7-b9df-cc24cc0ba14e May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-681ea0a9-6e75-4818-a566-75b670b88d66 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Request method failure captured: May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: POST /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0/os-volume_attachments HTTP/1.1 May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 74 May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6h_2ReNrnx1JyF_czjkEAP1FuuKwobsqEvhvInfqaSMw40CgNqIWA8A_vk7tsr0FV_LD0bCmm_eDbjudzYvptuB3YHMpvf76_Q9bPzPUDO6TB58uh-JSMbCrz2YGnMhaGsyJsPiGIuEP-UECWBwo39-BQHYqnkGew60A4fcmeNHaS8 May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:33:50.619455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:33:50.621092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2020e2bf35744af9161d7cf3e8bd345", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:33:50.621092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:33:50.621092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:33:50.621092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:33:50.621092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:33:50.621092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:33:50.621092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:33:50.621092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: 06431315dc8040cbbafbe83a3ed8e0e4 May 23 15:33:50.621092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:33:50.621092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: May 23 15:33:50.621092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {"volumeAttachment": {"volumeId": "7ece2194-5ae3-41dd-8093-100a4148172a"}} May 23 15:33:50.621092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Invalid volume: volume 7ece2194-5ae3-41dd-8093-100a4148172a is already attached to instances: e30f7223-50a4-46a7-b9df-cc24cc0ba14e May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'server_id': 'cc0f4046-cea9-4426-9970-4ff8f307a3c0', 'body': {'volumeAttachment': {'volumeId': '7ece2194-5ae3-41dd-8093-100a4148172a'}}} May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7ece2194-5ae3-41dd-8093-100a4148172a is already attached to instances: e30f7223-50a4-46a7-b9df-cc24cc0ba14e May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:33:50.622014 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7ece2194-5ae3-41dd-8093-100a4148172a is already attached to instances: e30f7223-50a4-46a7-b9df-cc24cc0ba14e May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:33:50.623440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:33:50.625062 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:33:50.625062 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:33:50.625062 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:33:50.625062 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7ece2194-5ae3-41dd-8093-100a4148172a is already attached to instances: e30f7223-50a4-46a7-b9df-cc24cc0ba14e May 23 15:33:50.625062 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:33:50.625062 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-681ea0a9-6e75-4818-a566-75b670b88d66 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Returning 400 to user: Invalid volume: volume 7ece2194-5ae3-41dd-8093-100a4148172a is already attached to instances: e30f7223-50a4-46a7-b9df-cc24cc0ba14e {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:33:50.625062 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-681ea0a9-6e75-4818-a566-75b670b88d66 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "POST /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098013 May 23 15:33:50.625062 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 268/542] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 15:33:50 2022] POST /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 15:33:50.629924 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-17037807-66ca-46b1-917d-47d0118af2b1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:50.630432 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-17037807-66ca-46b1-917d-47d0118af2b1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:50.636458 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-17037807-66ca-46b1-917d-47d0118af2b1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:50.636934 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-17037807-66ca-46b1-917d-47d0118af2b1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:50.637699 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-17037807-66ca-46b1-917d-47d0118af2b1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:50.638183 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-17037807-66ca-46b1-917d-47d0118af2b1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:50.666326 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-17037807-66ca-46b1-917d-47d0118af2b1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Going to try to terminate instance {{(pid=117974) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:33:50.743331 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-17037807-66ca-46b1-917d-47d0118af2b1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 204 len: 0 microversion: 2.1 time: 0.116837 May 23 15:33:50.743841 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 275/543] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:33:50 2022] DELETE /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:33:50.752800 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ee8ad166-f54f-48a1-896a-8309d4587c49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:50.753608 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ee8ad166-f54f-48a1-896a-8309d4587c49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:50.761667 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ee8ad166-f54f-48a1-896a-8309d4587c49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:50.762118 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ee8ad166-f54f-48a1-896a-8309d4587c49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:50.762882 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ee8ad166-f54f-48a1-896a-8309d4587c49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:50.763504 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ee8ad166-f54f-48a1-896a-8309d4587c49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:50.896102 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ee8ad166-f54f-48a1-896a-8309d4587c49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:50.903786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ee8ad166-f54f-48a1-896a-8309d4587c49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1679 microversion: 2.1 time: 0.155639 May 23 15:33:50.904358 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 269/544] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:50 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:51.504101 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-12c4cb4e-2143-48d9-abac-1177cf17f9cf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:51.504692 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-12c4cb4e-2143-48d9-abac-1177cf17f9cf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:51.511279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-12c4cb4e-2143-48d9-abac-1177cf17f9cf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:51.511736 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-12c4cb4e-2143-48d9-abac-1177cf17f9cf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:51.512502 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-12c4cb4e-2143-48d9-abac-1177cf17f9cf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:51.513050 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-12c4cb4e-2143-48d9-abac-1177cf17f9cf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:51.642638 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-12c4cb4e-2143-48d9-abac-1177cf17f9cf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lazy-loading 'services' on Instance uuid 9e1c71d3-9470-4f72-a76c-e6c114bd4821 {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:33:51.756482 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-12c4cb4e-2143-48d9-abac-1177cf17f9cf tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/os-volume_attachments/a96c7e0a-2507-4d1c-b096-edba6655ac9f" status: 202 len: 0 microversion: 2.1 time: 0.256538 May 23 15:33:51.757109 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 276/545] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 15:33:51 2022] DELETE /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/os-volume_attachments/a96c7e0a-2507-4d1c-b096-edba6655ac9f => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:33:51.921437 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f7b78380-2597-46e1-8f7e-591976dd3598 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:51.922007 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f7b78380-2597-46e1-8f7e-591976dd3598 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:51.928879 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f7b78380-2597-46e1-8f7e-591976dd3598 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:51.929354 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f7b78380-2597-46e1-8f7e-591976dd3598 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:51.930120 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f7b78380-2597-46e1-8f7e-591976dd3598 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:51.930561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f7b78380-2597-46e1-8f7e-591976dd3598 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:52.058293 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f7b78380-2597-46e1-8f7e-591976dd3598 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:52.065685 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f7b78380-2597-46e1-8f7e-591976dd3598 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1679 microversion: 2.1 time: 0.148510 May 23 15:33:52.066277 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 270/546] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:51 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:53.083968 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f9f2b216-8605-4e66-8814-d6bf1d0776ce tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:53.084680 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f9f2b216-8605-4e66-8814-d6bf1d0776ce tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:53.091005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f9f2b216-8605-4e66-8814-d6bf1d0776ce tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:53.092015 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f9f2b216-8605-4e66-8814-d6bf1d0776ce tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:53.092912 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f9f2b216-8605-4e66-8814-d6bf1d0776ce tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:53.093348 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f9f2b216-8605-4e66-8814-d6bf1d0776ce tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:53.312741 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-f9f2b216-8605-4e66-8814-d6bf1d0776ce tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:53.320895 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f9f2b216-8605-4e66-8814-d6bf1d0776ce tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1679 microversion: 2.1 time: 0.241684 May 23 15:33:53.321474 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 277/547] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:53 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1679 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:53.928832 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d4058c56-25db-4b8f-b7d3-7db17a9dc639 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:53.937656 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d4058c56-25db-4b8f-b7d3-7db17a9dc639 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:53.938354 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d4058c56-25db-4b8f-b7d3-7db17a9dc639 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:53.964295 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d4058c56-25db-4b8f-b7d3-7db17a9dc639 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Going to try to stop instance {{(pid=117973) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 15:33:53.996747 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-1e116d8e-64a6-43c4-9087-259131999ac5 req-f81512e3-7993-4806-847f-96891a786ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0f4046-cea9-4426-9970-4ff8f307a3c0", "name": "network-vif-deleted", "tag": "5ecea450-0a05-473a-b7b2-1cd3cef1fd28"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:54.014840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-1e116d8e-64a6-43c4-9087-259131999ac5 req-f81512e3-7993-4806-847f-96891a786ee4 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:54.015569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-1e116d8e-64a6-43c4-9087-259131999ac5 req-f81512e3-7993-4806-847f-96891a786ee4 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:54.036366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-1e116d8e-64a6-43c4-9087-259131999ac5 req-f81512e3-7993-4806-847f-96891a786ee4 service nova] Creating event network-vif-deleted:5ecea450-0a05-473a-b7b2-1cd3cef1fd28 for instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 on hv-cinder-84112 May 23 15:33:54.042329 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-1e116d8e-64a6-43c4-9087-259131999ac5 req-f81512e3-7993-4806-847f-96891a786ee4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054930 May 23 15:33:54.042854 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 278/548] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:33:54.054131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d4058c56-25db-4b8f-b7d3-7db17a9dc639 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "POST /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/action" status: 202 len: 0 microversion: 2.1 time: 0.130993 May 23 15:33:54.055284 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 271/549] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 15:33:53 2022] POST /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:33:54.064438 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-0d420ead-fc44-4f9e-b761-2059cd39c6d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:54.065558 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-0d420ead-fc44-4f9e-b761-2059cd39c6d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:54.072058 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0d420ead-fc44-4f9e-b761-2059cd39c6d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:54.072707 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0d420ead-fc44-4f9e-b761-2059cd39c6d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:54.073669 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0d420ead-fc44-4f9e-b761-2059cd39c6d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:54.074266 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0d420ead-fc44-4f9e-b761-2059cd39c6d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:54.212094 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0d420ead-fc44-4f9e-b761-2059cd39c6d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:54.221705 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-0d420ead-fc44-4f9e-b761-2059cd39c6d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1675 microversion: 2.1 time: 0.162189 May 23 15:33:54.226869 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 279/550] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:54 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:33:54.338688 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ad1d186e-557d-491a-b3bc-1d48ba9062c1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:54.339445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ad1d186e-557d-491a-b3bc-1d48ba9062c1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:54.345988 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ad1d186e-557d-491a-b3bc-1d48ba9062c1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:54.346444 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ad1d186e-557d-491a-b3bc-1d48ba9062c1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:54.347219 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ad1d186e-557d-491a-b3bc-1d48ba9062c1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:54.347695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ad1d186e-557d-491a-b3bc-1d48ba9062c1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:54.379498 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ad1d186e-557d-491a-b3bc-1d48ba9062c1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:54.379964 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ad1d186e-557d-491a-b3bc-1d48ba9062c1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:54.380428 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.objects.instance [None req-ad1d186e-557d-491a-b3bc-1d48ba9062c1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lazy-loading 'fault' on Instance uuid cc0f4046-cea9-4426-9970-4ff8f307a3c0 {{(pid=117973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:33:54.430111 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ad1d186e-557d-491a-b3bc-1d48ba9062c1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:54.440600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ad1d186e-557d-491a-b3bc-1d48ba9062c1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 200 len: 1331 microversion: 2.1 time: 0.105640 May 23 15:33:54.441699 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 272/551] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:54 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:55.239675 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-457950bc-f6b2-4d6c-a6bf-a402729570b5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:55.240285 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-457950bc-f6b2-4d6c-a6bf-a402729570b5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:55.246604 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-457950bc-f6b2-4d6c-a6bf-a402729570b5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:55.247050 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-457950bc-f6b2-4d6c-a6bf-a402729570b5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:55.248336 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-457950bc-f6b2-4d6c-a6bf-a402729570b5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:55.248767 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-457950bc-f6b2-4d6c-a6bf-a402729570b5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:55.379558 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-457950bc-f6b2-4d6c-a6bf-a402729570b5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:55.387255 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-457950bc-f6b2-4d6c-a6bf-a402729570b5 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1675 microversion: 2.1 time: 0.151386 May 23 15:33:55.387830 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 280/552] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:55 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:55.459486 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-70f41fed-3821-4c39-9211-30a0bd6c1f49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:55.460029 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-70f41fed-3821-4c39-9211-30a0bd6c1f49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:55.466054 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-70f41fed-3821-4c39-9211-30a0bd6c1f49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:55.466535 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-70f41fed-3821-4c39-9211-30a0bd6c1f49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:55.467304 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-70f41fed-3821-4c39-9211-30a0bd6c1f49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:55.467744 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-70f41fed-3821-4c39-9211-30a0bd6c1f49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:55.480877 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-70f41fed-3821-4c39-9211-30a0bd6c1f49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] HTTP exception thrown: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-70f41fed-3821-4c39-9211-30a0bd6c1f49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Request method failure captured: May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 HTTP/1.1 May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6h_2ReNrnx1JyF_czjkEAP1FuuKwobsqEvhvInfqaSMw40CgNqIWA8A_vk7tsr0FV_LD0bCmm_eDbjudzYvptuB3YHMpvf76_Q9bPzPUDO6TB58uh-JSMbCrz2YGnMhaGsyJsPiGIuEP-UECWBwo39-BQHYqnkGew60A4fcmeNHaS8 May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:33:55.482993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:33:55.484487 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2020e2bf35744af9161d7cf3e8bd345", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:33:55.484487 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:33:55.484487 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:33:55.484487 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:33:55.484487 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:33:55.484487 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:33:55.484487 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:33:55.484487 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: 06431315dc8040cbbafbe83a3ed8e0e4 May 23 15:33:55.484487 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:33:55.484487 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:33:55.484487 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. May 23 15:33:55.484487 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': 'cc0f4046-cea9-4426-9970-4ff8f307a3c0'} May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:33:55.488546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. May 23 15:33:55.489949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:33:55.491280 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-70f41fed-3821-4c39-9211-30a0bd6c1f49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Returning 404 to user: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:33:55.491280 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-70f41fed-3821-4c39-9211-30a0bd6c1f49 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 404 len: 111 microversion: 2.1 time: 0.029091 May 23 15:33:55.491280 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 273/553] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:55 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:33:55.495410 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8b4e441e-e0a9-4d9b-a764-b640761ef1bf tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '.version_select at 0x7f0d7a365af0>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:55.515313 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8b4e441e-e0a9-4d9b-a764-b640761ef1bf tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1923131915" status: 202 len: 0 microversion: 2.1 time: 0.024909 May 23 15:33:55.515994 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 281/554] 10.222.0.30 () {58 vars in 1220 bytes} [Mon May 23 15:33:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1923131915 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:33:56.406664 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-4644f285-e582-4957-a929-af083bc0fbc9 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:56.407711 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-4644f285-e582-4957-a929-af083bc0fbc9 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:56.410090 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=38 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:56.415710 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4644f285-e582-4957-a929-af083bc0fbc9 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:56.416390 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4644f285-e582-4957-a929-af083bc0fbc9 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:56.417509 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4644f285-e582-4957-a929-af083bc0fbc9 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:56.418193 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4644f285-e582-4957-a929-af083bc0fbc9 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:56.449729 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-48bc5ca3-8a44-4700-99fa-35ca5225e21b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:56.450386 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-48bc5ca3-8a44-4700-99fa-35ca5225e21b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:56.458786 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-48bc5ca3-8a44-4700-99fa-35ca5225e21b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:56.459386 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-48bc5ca3-8a44-4700-99fa-35ca5225e21b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:56.460271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-48bc5ca3-8a44-4700-99fa-35ca5225e21b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:56.460821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-48bc5ca3-8a44-4700-99fa-35ca5225e21b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:56.556414 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-48bc5ca3-8a44-4700-99fa-35ca5225e21b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lazy-loading 'services' on Instance uuid e30f7223-50a4-46a7-b9df-cc24cc0ba14e {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:33:56.569975 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-4644f285-e582-4957-a929-af083bc0fbc9 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:56.578758 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-4644f285-e582-4957-a929-af083bc0fbc9 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1675 microversion: 2.1 time: 0.177161 May 23 15:33:56.579341 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 274/555] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:56 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:56.640089 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-48bc5ca3-8a44-4700-99fa-35ca5225e21b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e/os-volume_attachments/7ece2194-5ae3-41dd-8093-100a4148172a" status: 202 len: 0 microversion: 2.1 time: 0.194300 May 23 15:33:56.640715 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 282/556] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 15:33:56 2022] DELETE /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e/os-volume_attachments/7ece2194-5ae3-41dd-8093-100a4148172a => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:33:56.650436 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-2825938f-de89-4fcb-b538-37794bd21102 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:56.651509 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-2825938f-de89-4fcb-b538-37794bd21102 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:56.659009 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2825938f-de89-4fcb-b538-37794bd21102 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:56.659623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2825938f-de89-4fcb-b538-37794bd21102 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:56.660596 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2825938f-de89-4fcb-b538-37794bd21102 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:56.661114 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2825938f-de89-4fcb-b538-37794bd21102 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:56.696335 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-2825938f-de89-4fcb-b538-37794bd21102 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050874 May 23 15:33:56.696930 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 275/557] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:33:56 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:57.597066 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2d18f469-8118-4e56-a1c8-18a62f235532 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:57.597773 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-2d18f469-8118-4e56-a1c8-18a62f235532 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:57.605632 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2d18f469-8118-4e56-a1c8-18a62f235532 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:57.606086 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2d18f469-8118-4e56-a1c8-18a62f235532 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:57.606892 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2d18f469-8118-4e56-a1c8-18a62f235532 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:57.607877 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2d18f469-8118-4e56-a1c8-18a62f235532 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:57.708182 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-20e9a72a-5517-4565-a6d5-833a6817a6e2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:57.709235 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-20e9a72a-5517-4565-a6d5-833a6817a6e2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:57.715986 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-20e9a72a-5517-4565-a6d5-833a6817a6e2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:57.716557 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-20e9a72a-5517-4565-a6d5-833a6817a6e2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:57.717529 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-20e9a72a-5517-4565-a6d5-833a6817a6e2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:57.717979 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-20e9a72a-5517-4565-a6d5-833a6817a6e2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:57.748293 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-20e9a72a-5517-4565-a6d5-833a6817a6e2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044224 May 23 15:33:57.749152 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 276/558] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:33:57 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:33:57.759548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-2d18f469-8118-4e56-a1c8-18a62f235532 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:57.771952 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-2d18f469-8118-4e56-a1c8-18a62f235532 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1675 microversion: 2.1 time: 0.179045 May 23 15:33:57.772531 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 283/559] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:57 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:57.809605 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ab39136a-1767-45ef-bbf2-0e1b49b90811 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:57.810130 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ab39136a-1767-45ef-bbf2-0e1b49b90811 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:57.816444 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ab39136a-1767-45ef-bbf2-0e1b49b90811 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:57.816913 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ab39136a-1767-45ef-bbf2-0e1b49b90811 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:57.817685 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ab39136a-1767-45ef-bbf2-0e1b49b90811 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:57.818120 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ab39136a-1767-45ef-bbf2-0e1b49b90811 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:57.848537 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ab39136a-1767-45ef-bbf2-0e1b49b90811 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Going to try to terminate instance {{(pid=117973) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:33:57.929330 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ab39136a-1767-45ef-bbf2-0e1b49b90811 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 204 len: 0 microversion: 2.1 time: 0.123313 May 23 15:33:57.929902 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 277/560] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:33:57 2022] DELETE /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:33:57.938883 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-68b5fa6e-2de1-4f39-bbb0-97c05f4b5c3d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:57.939542 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-68b5fa6e-2de1-4f39-bbb0-97c05f4b5c3d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:57.945469 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-68b5fa6e-2de1-4f39-bbb0-97c05f4b5c3d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:57.945926 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-68b5fa6e-2de1-4f39-bbb0-97c05f4b5c3d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:57.946693 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-68b5fa6e-2de1-4f39-bbb0-97c05f4b5c3d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:57.947130 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-68b5fa6e-2de1-4f39-bbb0-97c05f4b5c3d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:58.073271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-68b5fa6e-2de1-4f39-bbb0-97c05f4b5c3d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:58.080912 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-68b5fa6e-2de1-4f39-bbb0-97c05f4b5c3d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1678 microversion: 2.1 time: 0.146714 May 23 15:33:58.081485 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 284/561] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:57 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:58.790552 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-e7b19a79-f37a-4ef6-8266-e91dd5495cc3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:58.791250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-e7b19a79-f37a-4ef6-8266-e91dd5495cc3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:58.797753 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e7b19a79-f37a-4ef6-8266-e91dd5495cc3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:58.798205 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e7b19a79-f37a-4ef6-8266-e91dd5495cc3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:58.798960 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e7b19a79-f37a-4ef6-8266-e91dd5495cc3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:58.799395 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e7b19a79-f37a-4ef6-8266-e91dd5495cc3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:58.929961 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-e7b19a79-f37a-4ef6-8266-e91dd5495cc3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:58.937292 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-e7b19a79-f37a-4ef6-8266-e91dd5495cc3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1675 microversion: 2.1 time: 0.150897 May 23 15:33:58.937879 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 278/562] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:58 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:59.098731 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ae2142fc-9241-43b0-b994-1bd9222d6548 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:59.099278 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ae2142fc-9241-43b0-b994-1bd9222d6548 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:59.105864 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ae2142fc-9241-43b0-b994-1bd9222d6548 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:59.106308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ae2142fc-9241-43b0-b994-1bd9222d6548 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:59.107756 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ae2142fc-9241-43b0-b994-1bd9222d6548 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:59.108187 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ae2142fc-9241-43b0-b994-1bd9222d6548 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:59.238610 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ae2142fc-9241-43b0-b994-1bd9222d6548 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:33:59.246043 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ae2142fc-9241-43b0-b994-1bd9222d6548 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1678 microversion: 2.1 time: 0.151255 May 23 15:33:59.246605 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 285/563] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:59 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:33:59.954138 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b5928c60-467b-45c5-929a-6e06900103b0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:59.954762 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b5928c60-467b-45c5-929a-6e06900103b0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:33:59.961436 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b5928c60-467b-45c5-929a-6e06900103b0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:59.961894 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b5928c60-467b-45c5-929a-6e06900103b0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:59.962665 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b5928c60-467b-45c5-929a-6e06900103b0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:33:59.963114 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b5928c60-467b-45c5-929a-6e06900103b0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:33:59.965784 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:00.093383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b5928c60-467b-45c5-929a-6e06900103b0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:00.101116 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b5928c60-467b-45c5-929a-6e06900103b0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1675 microversion: 2.1 time: 0.151336 May 23 15:34:00.101687 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 279/564] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:33:59 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:00.263621 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-411c904a-4ebf-493b-b429-88a09c4c6a39 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:00.264370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-411c904a-4ebf-493b-b429-88a09c4c6a39 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:00.271104 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-411c904a-4ebf-493b-b429-88a09c4c6a39 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:00.271557 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-411c904a-4ebf-493b-b429-88a09c4c6a39 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:00.272337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-411c904a-4ebf-493b-b429-88a09c4c6a39 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:00.272777 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-411c904a-4ebf-493b-b429-88a09c4c6a39 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:00.275598 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:00.693009 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-411c904a-4ebf-493b-b429-88a09c4c6a39 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:00.702670 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-411c904a-4ebf-493b-b429-88a09c4c6a39 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 200 len: 1678 microversion: 2.1 time: 0.441090 May 23 15:34:00.703892 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 286/565] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:00 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 1678 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:01.088097 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-d86bfaa6-d37a-40a2-9bef-4533a95a7300 req-99e7a3b6-0d7b-4b07-b766-4922faba0d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30f7223-50a4-46a7-b9df-cc24cc0ba14e", "name": "network-vif-deleted", "tag": "844b0f3e-da49-4384-9cfa-321053312dea"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:01.099582 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-d86bfaa6-d37a-40a2-9bef-4533a95a7300 req-99e7a3b6-0d7b-4b07-b766-4922faba0d10 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:01.100302 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-d86bfaa6-d37a-40a2-9bef-4533a95a7300 req-99e7a3b6-0d7b-4b07-b766-4922faba0d10 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:01.113739 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-d86bfaa6-d37a-40a2-9bef-4533a95a7300 req-99e7a3b6-0d7b-4b07-b766-4922faba0d10 service nova] Creating event network-vif-deleted:844b0f3e-da49-4384-9cfa-321053312dea for instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e on hv-cinder-84112 May 23 15:34:01.119268 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-471252aa-e9d4-4d21-91fe-234c5238bf65 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:01.119457 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-d86bfaa6-d37a-40a2-9bef-4533a95a7300 req-99e7a3b6-0d7b-4b07-b766-4922faba0d10 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035143 May 23 15:34:01.120147 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-471252aa-e9d4-4d21-91fe-234c5238bf65 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:01.120978 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 280/566] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:01.128155 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-471252aa-e9d4-4d21-91fe-234c5238bf65 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:01.128615 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-471252aa-e9d4-4d21-91fe-234c5238bf65 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:01.129490 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-471252aa-e9d4-4d21-91fe-234c5238bf65 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:01.130320 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-471252aa-e9d4-4d21-91fe-234c5238bf65 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:01.290930 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-471252aa-e9d4-4d21-91fe-234c5238bf65 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:01.304589 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-471252aa-e9d4-4d21-91fe-234c5238bf65 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1675 microversion: 2.1 time: 0.189855 May 23 15:34:01.305572 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 287/567] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:01 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1675 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:01.722019 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-de83d24a-2b0e-4249-8a0d-feaf28e01d6b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:01.722775 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-de83d24a-2b0e-4249-8a0d-feaf28e01d6b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:01.729872 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-de83d24a-2b0e-4249-8a0d-feaf28e01d6b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:01.730596 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-de83d24a-2b0e-4249-8a0d-feaf28e01d6b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:01.731554 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-de83d24a-2b0e-4249-8a0d-feaf28e01d6b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:01.733210 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-de83d24a-2b0e-4249-8a0d-feaf28e01d6b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:01.750705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-de83d24a-2b0e-4249-8a0d-feaf28e01d6b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] HTTP exception thrown: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-de83d24a-2b0e-4249-8a0d-feaf28e01d6b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Request method failure captured: May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e HTTP/1.1 May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6h_2ReNrnx1JyF_czjkEAP1FuuKwobsqEvhvInfqaSMw40CgNqIWA8A_vk7tsr0FV_LD0bCmm_eDbjudzYvptuB3YHMpvf76_Q9bPzPUDO6TB58uh-JSMbCrz2YGnMhaGsyJsPiGIuEP-UECWBwo39-BQHYqnkGew60A4fcmeNHaS8 May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:34:01.752646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:34:01.753915 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2020e2bf35744af9161d7cf3e8bd345", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:34:01.753915 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:34:01.753915 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:34:01.753915 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:34:01.753915 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:34:01.753915 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:34:01.753915 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:34:01.753915 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: 06431315dc8040cbbafbe83a3ed8e0e4 May 23 15:34:01.753915 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:34:01.753915 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:34:01.753915 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. May 23 15:34:01.753915 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': 'e30f7223-50a4-46a7-b9df-cc24cc0ba14e'} May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:34:01.754600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. May 23 15:34:01.755705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:01.756747 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-de83d24a-2b0e-4249-8a0d-feaf28e01d6b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Returning 404 to user: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:34:01.756747 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-de83d24a-2b0e-4249-8a0d-feaf28e01d6b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 404 len: 111 microversion: 2.1 time: 0.036589 May 23 15:34:01.756747 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 281/568] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:01 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:34:01.763329 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d2232f02-b7bf-4bb6-9e1c-ed3761b09a8b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '.version_select at 0x7f0d7a4d5310>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:01.785825 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d2232f02-b7bf-4bb6-9e1c-ed3761b09a8b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-227834710" status: 202 len: 0 microversion: 2.1 time: 0.026337 May 23 15:34:01.786413 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 288/569] 10.222.0.30 () {58 vars in 1217 bytes} [Mon May 23 15:34:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-227834710 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:34:02.323169 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-09a7a0da-4917-4a8c-92eb-833529f7c20f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:02.323896 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-09a7a0da-4917-4a8c-92eb-833529f7c20f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:02.330534 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-09a7a0da-4917-4a8c-92eb-833529f7c20f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:02.330990 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-09a7a0da-4917-4a8c-92eb-833529f7c20f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:02.331757 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-09a7a0da-4917-4a8c-92eb-833529f7c20f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:02.332250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-09a7a0da-4917-4a8c-92eb-833529f7c20f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:02.440600 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-1e9e7a2f-5578-4d6c-9eb4-500fa169c9de tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Action: 'create', calling method: .version_select at 0x7f0d7a467550>, body: {"keypair": {"name": "tempest-keypair-1878670788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZyWlU2ljdKoxmYppjYu2EX8J52frHJJwD7VWv7nfex6OyLXZlnS+WMLAMHjzAsG5dkAcHWb4/WJgp56+xIRfCFQ00kwaO0buRACbo/bTDjSiWWgsOOwak2wxeoClWeoQ=="}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:02.455956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-1e9e7a2f-5578-4d6c-9eb4-500fa169c9de tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Getting quotas for project f2020e2bf35744af9161d7cf3e8bd345. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:34:02.459843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-1e9e7a2f-5578-4d6c-9eb4-500fa169c9de tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Getting quotas for user 06431315dc8040cbbafbe83a3ed8e0e4 and project f2020e2bf35744af9161d7cf3e8bd345. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:34:02.464150 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-09a7a0da-4917-4a8c-92eb-833529f7c20f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:02.471847 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-09a7a0da-4917-4a8c-92eb-833529f7c20f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1675 microversion: 2.1 time: 0.152984 May 23 15:34:02.472622 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 282/570] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:02 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:02.482322 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-1e9e7a2f-5578-4d6c-9eb4-500fa169c9de tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047710 May 23 15:34:02.482910 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 289/571] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 15:34:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:03.490156 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-bbb77b4e-c8e9-4af3-baa6-3e67113fe2f0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:03.490776 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-bbb77b4e-c8e9-4af3-baa6-3e67113fe2f0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:03.497292 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bbb77b4e-c8e9-4af3-baa6-3e67113fe2f0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:03.498248 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bbb77b4e-c8e9-4af3-baa6-3e67113fe2f0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:03.499030 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bbb77b4e-c8e9-4af3-baa6-3e67113fe2f0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:03.499480 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bbb77b4e-c8e9-4af3-baa6-3e67113fe2f0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:03.735816 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-bbb77b4e-c8e9-4af3-baa6-3e67113fe2f0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:03.743675 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-bbb77b4e-c8e9-4af3-baa6-3e67113fe2f0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1675 microversion: 2.1 time: 0.257488 May 23 15:34:03.744310 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 283/572] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:03 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1675 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:03.851712 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-dcd172e9-59e8-4e9c-8450-068ef7d62188 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-538703097", "imageRef": "807d39e3-2293-48ca-b2cd-675f7c931014", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9306d40-6dd5-4f4d-bb55-9077bd7b986d"}], "security_groups": [{"name": "tempest-securitygroup--2046916214"}], "key_name": "tempest-keypair-1878670788", "user_data": "}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:03.954623 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.network.neutron [None req-dcd172e9-59e8-4e9c-8450-068ef7d62188 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] validate_networks() for [('c9306d40-6dd5-4f4d-bb55-9077bd7b986d', None, None, None, None, None)] {{(pid=117974) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:34:04.316618 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-dcd172e9-59e8-4e9c-8450-068ef7d62188 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Flavor limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:34:04.317085 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-dcd172e9-59e8-4e9c-8450-068ef7d62188 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Image limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:34:04.317559 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-dcd172e9-59e8-4e9c-8450-068ef7d62188 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Flavor pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:34:04.317997 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-dcd172e9-59e8-4e9c-8450-068ef7d62188 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Image pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:34:04.318538 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-dcd172e9-59e8-4e9c-8450-068ef7d62188 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:34:04.327369 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-dcd172e9-59e8-4e9c-8450-068ef7d62188 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:04.327810 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-dcd172e9-59e8-4e9c-8450-068ef7d62188 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:04.328598 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-dcd172e9-59e8-4e9c-8450-068ef7d62188 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:04.329124 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-dcd172e9-59e8-4e9c-8450-068ef7d62188 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:04.346293 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-dcd172e9-59e8-4e9c-8450-068ef7d62188 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Getting quotas for project f2020e2bf35744af9161d7cf3e8bd345. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:34:04.350157 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-dcd172e9-59e8-4e9c-8450-068ef7d62188 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Getting quotas for user 06431315dc8040cbbafbe83a3ed8e0e4 and project f2020e2bf35744af9161d7cf3e8bd345. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:34:04.361677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-dcd172e9-59e8-4e9c-8450-068ef7d62188 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Going to run 1 instances... {{(pid=117974) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:34:04.363903 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-dcd172e9-59e8-4e9c-8450-068ef7d62188 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='807d39e3-2293-48ca-b2cd-675f7c931014',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:34:04.409601 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-dcd172e9-59e8-4e9c-8450-068ef7d62188 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.562810 May 23 15:34:04.410164 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 290/573] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:34:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:34:04.420800 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3143f7e7-67c0-45d8-b920-bcf38fe00be9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:04.421451 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-3143f7e7-67c0-45d8-b920-bcf38fe00be9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:04.480989 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3143f7e7-67c0-45d8-b920-bcf38fe00be9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:04.489257 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-3143f7e7-67c0-45d8-b920-bcf38fe00be9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 200 len: 1241 microversion: 2.1 time: 0.072510 May 23 15:34:04.490111 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 284/574] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:04 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:04.762955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d522c316-b49f-44ff-a86d-9517172f036d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:04.763639 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d522c316-b49f-44ff-a86d-9517172f036d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:04.770323 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d522c316-b49f-44ff-a86d-9517172f036d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:04.770773 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d522c316-b49f-44ff-a86d-9517172f036d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:04.771537 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d522c316-b49f-44ff-a86d-9517172f036d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:04.771969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d522c316-b49f-44ff-a86d-9517172f036d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:04.913398 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d522c316-b49f-44ff-a86d-9517172f036d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:04.921308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d522c316-b49f-44ff-a86d-9517172f036d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1652 microversion: 2.1 time: 0.162529 May 23 15:34:04.921865 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 291/575] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:04 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1652 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:04.937783 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-623b2f6c-d4bd-4d92-8835-21197b7c94de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:04.944218 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-623b2f6c-d4bd-4d92-8835-21197b7c94de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:04.944670 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-623b2f6c-d4bd-4d92-8835-21197b7c94de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:04.969725 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-623b2f6c-d4bd-4d92-8835-21197b7c94de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Going to try to start instance {{(pid=117973) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 15:34:05.009477 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-623b2f6c-d4bd-4d92-8835-21197b7c94de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "POST /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/action" status: 202 len: 0 microversion: 2.1 time: 0.075806 May 23 15:34:05.010074 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 285/576] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 15:34:04 2022] POST /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:34:05.019116 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ba3a04cb-ca1a-487e-af46-56f0c8b8091f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:05.020010 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ba3a04cb-ca1a-487e-af46-56f0c8b8091f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:05.026666 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ba3a04cb-ca1a-487e-af46-56f0c8b8091f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:05.027115 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ba3a04cb-ca1a-487e-af46-56f0c8b8091f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:05.027899 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ba3a04cb-ca1a-487e-af46-56f0c8b8091f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:05.028334 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ba3a04cb-ca1a-487e-af46-56f0c8b8091f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:05.174419 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ba3a04cb-ca1a-487e-af46-56f0c8b8091f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:05.181927 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ba3a04cb-ca1a-487e-af46-56f0c8b8091f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1661 microversion: 2.1 time: 0.167113 May 23 15:34:05.182494 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 292/577] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:05 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1661 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:05.507878 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-dfe09711-3050-4fb8-a43d-06557131dd90 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:05.508727 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-dfe09711-3050-4fb8-a43d-06557131dd90 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:05.515893 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-dfe09711-3050-4fb8-a43d-06557131dd90 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:05.516348 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-dfe09711-3050-4fb8-a43d-06557131dd90 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:05.517425 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-dfe09711-3050-4fb8-a43d-06557131dd90 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:05.517867 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-dfe09711-3050-4fb8-a43d-06557131dd90 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:05.639936 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-dfe09711-3050-4fb8-a43d-06557131dd90 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:05.648375 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-dfe09711-3050-4fb8-a43d-06557131dd90 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 200 len: 1301 microversion: 2.1 time: 0.144841 May 23 15:34:05.649251 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 286/578] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:05 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 1301 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:06.199676 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3cf6ef52-d56f-4e5a-b1f7-e0d0b40cf8cb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:06.201434 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3cf6ef52-d56f-4e5a-b1f7-e0d0b40cf8cb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:06.208006 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3cf6ef52-d56f-4e5a-b1f7-e0d0b40cf8cb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:06.208466 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3cf6ef52-d56f-4e5a-b1f7-e0d0b40cf8cb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:06.209271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3cf6ef52-d56f-4e5a-b1f7-e0d0b40cf8cb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:06.209715 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3cf6ef52-d56f-4e5a-b1f7-e0d0b40cf8cb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:06.358330 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3cf6ef52-d56f-4e5a-b1f7-e0d0b40cf8cb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:06.367022 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3cf6ef52-d56f-4e5a-b1f7-e0d0b40cf8cb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1661 microversion: 2.1 time: 0.171220 May 23 15:34:06.367607 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 293/579] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:06 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1661 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:06.665856 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-86fde795-467c-4f67-aa33-1cc1ed09380b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:06.666497 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-86fde795-467c-4f67-aa33-1cc1ed09380b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:06.673679 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86fde795-467c-4f67-aa33-1cc1ed09380b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:06.674128 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86fde795-467c-4f67-aa33-1cc1ed09380b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:06.674894 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86fde795-467c-4f67-aa33-1cc1ed09380b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:06.675332 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86fde795-467c-4f67-aa33-1cc1ed09380b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:06.871194 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-86fde795-467c-4f67-aa33-1cc1ed09380b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:06.879500 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-86fde795-467c-4f67-aa33-1cc1ed09380b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 200 len: 1367 microversion: 2.1 time: 0.217555 May 23 15:34:06.880069 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 287/580] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:06 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:07.132730 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-477b16a0-3b6b-4812-8350-dc74c78a84fc req-2fbd809e-40fd-487a-8812-6c6ada57d927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1742ffd2-9b97-445d-94ad-da23deebac48", "tag": "6fea56fd-ce2d-491d-b530-af4a33a7b17e"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:07.153081 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-477b16a0-3b6b-4812-8350-dc74c78a84fc req-2fbd809e-40fd-487a-8812-6c6ada57d927 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:07.155516 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-477b16a0-3b6b-4812-8350-dc74c78a84fc req-2fbd809e-40fd-487a-8812-6c6ada57d927 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:07.171643 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-477b16a0-3b6b-4812-8350-dc74c78a84fc req-2fbd809e-40fd-487a-8812-6c6ada57d927 service nova] Creating event network-changed:6fea56fd-ce2d-491d-b530-af4a33a7b17e for instance 1742ffd2-9b97-445d-94ad-da23deebac48 on hv-cinder-84112 May 23 15:34:07.178159 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-477b16a0-3b6b-4812-8350-dc74c78a84fc req-2fbd809e-40fd-487a-8812-6c6ada57d927 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050504 May 23 15:34:07.178769 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 294/581] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:07.385194 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-0a571d53-1bc0-473c-bb28-f34272a8a5ea tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:07.385806 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-0a571d53-1bc0-473c-bb28-f34272a8a5ea tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:07.392565 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0a571d53-1bc0-473c-bb28-f34272a8a5ea tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:07.393063 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0a571d53-1bc0-473c-bb28-f34272a8a5ea tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:07.393849 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0a571d53-1bc0-473c-bb28-f34272a8a5ea tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:07.394289 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0a571d53-1bc0-473c-bb28-f34272a8a5ea tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:07.609636 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-0a571d53-1bc0-473c-bb28-f34272a8a5ea tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:07.617519 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-0a571d53-1bc0-473c-bb28-f34272a8a5ea tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1665 microversion: 2.1 time: 0.236143 May 23 15:34:07.618082 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 288/582] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:07 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1665 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:07.898688 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-67b027be-b450-40eb-b317-9d2c899f820b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:07.899307 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-67b027be-b450-40eb-b317-9d2c899f820b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:07.906077 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-67b027be-b450-40eb-b317-9d2c899f820b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:07.906528 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-67b027be-b450-40eb-b317-9d2c899f820b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:07.907310 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-67b027be-b450-40eb-b317-9d2c899f820b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:07.907727 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-67b027be-b450-40eb-b317-9d2c899f820b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:08.035397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-67b027be-b450-40eb-b317-9d2c899f820b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:08.042980 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-67b027be-b450-40eb-b317-9d2c899f820b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 200 len: 1367 microversion: 2.1 time: 0.148617 May 23 15:34:08.043551 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 295/583] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:07 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:09.060133 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-bfa8c3d7-0b92-4fe8-81f0-6f10b684ff6a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:09.062209 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-bfa8c3d7-0b92-4fe8-81f0-6f10b684ff6a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:09.069216 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bfa8c3d7-0b92-4fe8-81f0-6f10b684ff6a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:09.069668 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bfa8c3d7-0b92-4fe8-81f0-6f10b684ff6a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:09.070698 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bfa8c3d7-0b92-4fe8-81f0-6f10b684ff6a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:09.071149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bfa8c3d7-0b92-4fe8-81f0-6f10b684ff6a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:09.297216 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-bfa8c3d7-0b92-4fe8-81f0-6f10b684ff6a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:09.305528 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-bfa8c3d7-0b92-4fe8-81f0-6f10b684ff6a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 200 len: 1367 microversion: 2.1 time: 0.249677 May 23 15:34:09.306108 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 289/584] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:09 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:10.052022 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-dc840c20-1bf8-4dcd-b229-8729bda87a4b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "393eef02-5358-419b-bd2d-0dcf6259445e"}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:10.053109 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-dc840c20-1bf8-4dcd-b229-8729bda87a4b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:10.055497 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:10.061092 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-dc840c20-1bf8-4dcd-b229-8729bda87a4b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:10.061539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-dc840c20-1bf8-4dcd-b229-8729bda87a4b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:10.062303 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-dc840c20-1bf8-4dcd-b229-8729bda87a4b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:10.062733 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-dc840c20-1bf8-4dcd-b229-8729bda87a4b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:10.324590 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-dc840c20-1bf8-4dcd-b229-8729bda87a4b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "POST /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276360 May 23 15:34:10.325083 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-12f8affe-79bd-4461-9227-1d0c79728cf1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:10.326038 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 296/585] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 15:34:10 2022] POST /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:10.326212 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-12f8affe-79bd-4461-9227-1d0c79728cf1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:10.332851 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-12f8affe-79bd-4461-9227-1d0c79728cf1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:10.333343 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-12f8affe-79bd-4461-9227-1d0c79728cf1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:10.334126 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-12f8affe-79bd-4461-9227-1d0c79728cf1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:10.334564 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-12f8affe-79bd-4461-9227-1d0c79728cf1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:10.470333 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-12f8affe-79bd-4461-9227-1d0c79728cf1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:10.477730 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-12f8affe-79bd-4461-9227-1d0c79728cf1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 200 len: 1367 microversion: 2.1 time: 0.156617 May 23 15:34:10.478297 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 290/586] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:10 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:11.502619 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d74cb518-aec4-41e2-98e4-1df966268b83 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:11.503325 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d74cb518-aec4-41e2-98e4-1df966268b83 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:11.514418 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d74cb518-aec4-41e2-98e4-1df966268b83 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:11.515235 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d74cb518-aec4-41e2-98e4-1df966268b83 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:11.516134 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d74cb518-aec4-41e2-98e4-1df966268b83 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:11.516570 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d74cb518-aec4-41e2-98e4-1df966268b83 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:11.652166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d74cb518-aec4-41e2-98e4-1df966268b83 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:11.660172 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d74cb518-aec4-41e2-98e4-1df966268b83 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 200 len: 1367 microversion: 2.1 time: 0.164581 May 23 15:34:11.660979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 297/587] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:11 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:12.677056 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c0234f2c-5154-43b5-8f18-400604922eec tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:12.677675 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c0234f2c-5154-43b5-8f18-400604922eec tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:12.684245 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c0234f2c-5154-43b5-8f18-400604922eec tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:12.684695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c0234f2c-5154-43b5-8f18-400604922eec tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:12.686164 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c0234f2c-5154-43b5-8f18-400604922eec tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:12.686604 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c0234f2c-5154-43b5-8f18-400604922eec tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:12.820705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c0234f2c-5154-43b5-8f18-400604922eec tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:12.828261 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c0234f2c-5154-43b5-8f18-400604922eec tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 200 len: 1367 microversion: 2.1 time: 0.155215 May 23 15:34:12.828836 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 291/588] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:12 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:13.818947 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-7127c802-0608-461e-8f33-4c21ef43ad36 req-8410d17a-86cf-46f6-b77c-dc6e37f26dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1742ffd2-9b97-445d-94ad-da23deebac48", "name": "network-vif-plugged", "status": "completed", "tag": "6fea56fd-ce2d-491d-b530-af4a33a7b17e"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:13.828638 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-7127c802-0608-461e-8f33-4c21ef43ad36 req-8410d17a-86cf-46f6-b77c-dc6e37f26dfa service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:13.829306 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-7127c802-0608-461e-8f33-4c21ef43ad36 req-8410d17a-86cf-46f6-b77c-dc6e37f26dfa service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:13.842911 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-7127c802-0608-461e-8f33-4c21ef43ad36 req-8410d17a-86cf-46f6-b77c-dc6e37f26dfa service nova] Creating event network-vif-plugged:6fea56fd-ce2d-491d-b530-af4a33a7b17e for instance 1742ffd2-9b97-445d-94ad-da23deebac48 on hv-cinder-84112 May 23 15:34:13.845066 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-4a18904f-d8a3-491a-8729-e0fd2a9dfc04 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:13.845786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-4a18904f-d8a3-491a-8729-e0fd2a9dfc04 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:13.848629 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-7127c802-0608-461e-8f33-4c21ef43ad36 req-8410d17a-86cf-46f6-b77c-dc6e37f26dfa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032740 May 23 15:34:13.849206 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 298/589] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:13.854189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4a18904f-d8a3-491a-8729-e0fd2a9dfc04 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:13.854189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4a18904f-d8a3-491a-8729-e0fd2a9dfc04 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:13.855331 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4a18904f-d8a3-491a-8729-e0fd2a9dfc04 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:13.855836 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4a18904f-d8a3-491a-8729-e0fd2a9dfc04 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:13.930630 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ec95ed28-a003-4f9e-8c47-65313ae8f777 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:13.931538 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ec95ed28-a003-4f9e-8c47-65313ae8f777 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:13.938821 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ec95ed28-a003-4f9e-8c47-65313ae8f777 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:13.939282 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ec95ed28-a003-4f9e-8c47-65313ae8f777 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:13.940066 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ec95ed28-a003-4f9e-8c47-65313ae8f777 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:13.940507 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ec95ed28-a003-4f9e-8c47-65313ae8f777 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:13.975969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ec95ed28-a003-4f9e-8c47-65313ae8f777 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-volume_attachments/af0693b7-13da-44fe-b90a-e073a95efad2" status: 200 len: 194 microversion: 2.20 time: 0.049804 May 23 15:34:13.976739 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 299/590] 10.222.0.30 () {60 vars in 1453 bytes} [Mon May 23 15:34:13 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-volume_attachments/af0693b7-13da-44fe-b90a-e073a95efad2 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 15:34:13.999812 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-4a18904f-d8a3-491a-8729-e0fd2a9dfc04 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:14.022234 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-4a18904f-d8a3-491a-8729-e0fd2a9dfc04 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 200 len: 1367 microversion: 2.1 time: 0.181969 May 23 15:34:14.023562 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 292/591] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:13 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:34:14.054269 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b8df5fe7-df4d-4cea-be10-714437bbca34 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:14.054869 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b8df5fe7-df4d-4cea-be10-714437bbca34 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:14.061115 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b8df5fe7-df4d-4cea-be10-714437bbca34 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:14.061671 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b8df5fe7-df4d-4cea-be10-714437bbca34 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:14.062510 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b8df5fe7-df4d-4cea-be10-714437bbca34 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:14.063044 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b8df5fe7-df4d-4cea-be10-714437bbca34 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:14.146346 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-b8df5fe7-df4d-4cea-be10-714437bbca34 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lazy-loading 'services' on Instance uuid 9b9038c8-1395-4d48-b10b-2fe7310c4c76 {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:34:14.217548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b8df5fe7-df4d-4cea-be10-714437bbca34 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-volume_attachments/af0693b7-13da-44fe-b90a-e073a95efad2" status: 202 len: 0 microversion: 2.20 time: 0.166384 May 23 15:34:14.218130 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 300/592] 10.222.0.30 () {60 vars in 1456 bytes} [Mon May 23 15:34:14 2022] DELETE /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-volume_attachments/af0693b7-13da-44fe-b90a-e073a95efad2 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 15:34:14.226544 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f56ad197-cd6a-4ae6-98f5-78a6680d39d9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:14.227474 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f56ad197-cd6a-4ae6-98f5-78a6680d39d9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:14.234036 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f56ad197-cd6a-4ae6-98f5-78a6680d39d9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:14.234487 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f56ad197-cd6a-4ae6-98f5-78a6680d39d9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:14.235248 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f56ad197-cd6a-4ae6-98f5-78a6680d39d9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:14.235687 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f56ad197-cd6a-4ae6-98f5-78a6680d39d9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:14.268020 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f56ad197-cd6a-4ae6-98f5-78a6680d39d9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045534 May 23 15:34:14.268576 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 293/593] 10.222.0.30 () {60 vars in 1342 bytes} [Mon May 23 15:34:14 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 15:34:15.037166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=2 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:15.037933 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=10 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:15.042426 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-49f5a37f-eefa-4b30-870f-99c43cfab186 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:15.043133 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-49f5a37f-eefa-4b30-870f-99c43cfab186 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:15.050980 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-49f5a37f-eefa-4b30-870f-99c43cfab186 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:15.051464 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-49f5a37f-eefa-4b30-870f-99c43cfab186 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:15.052233 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-49f5a37f-eefa-4b30-870f-99c43cfab186 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:15.052682 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-49f5a37f-eefa-4b30-870f-99c43cfab186 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:15.181113 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-49f5a37f-eefa-4b30-870f-99c43cfab186 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:15.189111 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-49f5a37f-eefa-4b30-870f-99c43cfab186 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 200 len: 1367 microversion: 2.1 time: 0.153319 May 23 15:34:15.189668 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 301/594] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:15 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:15.279916 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c200ed24-c43d-436d-b3bd-bc21fcf3442e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:15.280833 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c200ed24-c43d-436d-b3bd-bc21fcf3442e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:15.282807 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:15.289146 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c200ed24-c43d-436d-b3bd-bc21fcf3442e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:15.289547 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c200ed24-c43d-436d-b3bd-bc21fcf3442e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:15.290321 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c200ed24-c43d-436d-b3bd-bc21fcf3442e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:15.290761 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c200ed24-c43d-436d-b3bd-bc21fcf3442e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:15.320509 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c200ed24-c43d-436d-b3bd-bc21fcf3442e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044700 May 23 15:34:15.321102 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 294/595] 10.222.0.30 () {60 vars in 1342 bytes} [Mon May 23 15:34:15 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:34:16.206525 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c147e923-495c-4189-b1af-4791d7c83161 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:16.207132 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-c147e923-495c-4189-b1af-4791d7c83161 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:16.213609 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c147e923-495c-4189-b1af-4791d7c83161 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:16.214056 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c147e923-495c-4189-b1af-4791d7c83161 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:16.214811 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c147e923-495c-4189-b1af-4791d7c83161 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:16.215242 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c147e923-495c-4189-b1af-4791d7c83161 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:16.332458 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f8ea9838-6ce9-4b90-bc94-7e6446bb22f3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:16.333527 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f8ea9838-6ce9-4b90-bc94-7e6446bb22f3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:16.340024 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f8ea9838-6ce9-4b90-bc94-7e6446bb22f3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:16.340482 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f8ea9838-6ce9-4b90-bc94-7e6446bb22f3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:16.341297 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f8ea9838-6ce9-4b90-bc94-7e6446bb22f3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:16.341884 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f8ea9838-6ce9-4b90-bc94-7e6446bb22f3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:16.342363 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c147e923-495c-4189-b1af-4791d7c83161 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:16.349957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-c147e923-495c-4189-b1af-4791d7c83161 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 200 len: 1555 microversion: 2.1 time: 0.147280 May 23 15:34:16.350531 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 302/596] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:16 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:16.366645 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ef93e0a0-feda-438b-aa9b-7b1210eb22cc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:16.367144 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ef93e0a0-feda-438b-aa9b-7b1210eb22cc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:16.371865 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f8ea9838-6ce9-4b90-bc94-7e6446bb22f3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043437 May 23 15:34:16.372428 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 295/597] 10.222.0.30 () {60 vars in 1342 bytes} [Mon May 23 15:34:16 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 15:34:16.373590 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ef93e0a0-feda-438b-aa9b-7b1210eb22cc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:16.374043 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ef93e0a0-feda-438b-aa9b-7b1210eb22cc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:16.374820 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ef93e0a0-feda-438b-aa9b-7b1210eb22cc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:16.375262 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ef93e0a0-feda-438b-aa9b-7b1210eb22cc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:16.454373 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ef93e0a0-feda-438b-aa9b-7b1210eb22cc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091333 May 23 15:34:16.454959 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 303/598] 10.222.0.30 () {58 vars in 1274 bytes} [Mon May 23 15:34:16 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:34:17.383824 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1d135335-8846-440b-ba2e-b1cceae7f74b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:17.384744 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-1d135335-8846-440b-ba2e-b1cceae7f74b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:17.391443 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1d135335-8846-440b-ba2e-b1cceae7f74b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:17.391893 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1d135335-8846-440b-ba2e-b1cceae7f74b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:17.392953 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1d135335-8846-440b-ba2e-b1cceae7f74b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:17.393386 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1d135335-8846-440b-ba2e-b1cceae7f74b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:17.422601 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1d135335-8846-440b-ba2e-b1cceae7f74b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042781 May 23 15:34:17.423165 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 296/599] 10.222.0.30 () {60 vars in 1342 bytes} [Mon May 23 15:34:17 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:34:17.588761 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-b30cb0d1-86dc-4601-9674-4d113ce63a79 req-0797ef69-36de-43dd-a943-ca738772d481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1742ffd2-9b97-445d-94ad-da23deebac48", "tag": "6fea56fd-ce2d-491d-b530-af4a33a7b17e"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:17.600691 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-b30cb0d1-86dc-4601-9674-4d113ce63a79 req-0797ef69-36de-43dd-a943-ca738772d481 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:17.601185 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-b30cb0d1-86dc-4601-9674-4d113ce63a79 req-0797ef69-36de-43dd-a943-ca738772d481 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:17.614430 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-b30cb0d1-86dc-4601-9674-4d113ce63a79 req-0797ef69-36de-43dd-a943-ca738772d481 service nova] Creating event network-changed:6fea56fd-ce2d-491d-b530-af4a33a7b17e for instance 1742ffd2-9b97-445d-94ad-da23deebac48 on hv-cinder-84112 May 23 15:34:17.619209 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-b30cb0d1-86dc-4601-9674-4d113ce63a79 req-0797ef69-36de-43dd-a943-ca738772d481 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036346 May 23 15:34:17.619863 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 304/600] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:17.876924 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-559a3d40-935a-4c6b-adfa-1a9a85d3439f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:17.878532 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-559a3d40-935a-4c6b-adfa-1a9a85d3439f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:17.885202 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-559a3d40-935a-4c6b-adfa-1a9a85d3439f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:17.885943 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-559a3d40-935a-4c6b-adfa-1a9a85d3439f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:17.886734 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-559a3d40-935a-4c6b-adfa-1a9a85d3439f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:17.887366 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-559a3d40-935a-4c6b-adfa-1a9a85d3439f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:17.891221 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:17.915712 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.objects.instance [None req-559a3d40-935a-4c6b-adfa-1a9a85d3439f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lazy-loading 'flavor' on Instance uuid bb26539d-bd10-48dd-9c5d-433060babfb6 {{(pid=117973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:34:18.072858 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-559a3d40-935a-4c6b-adfa-1a9a85d3439f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "POST /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/action" status: 200 len: 32 microversion: 2.1 time: 0.200133 May 23 15:34:18.074589 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 297/601] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 15:34:17 2022] POST /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:34:18.085394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-1597a435-edc2-4a12-a581-e6b0791dcb73 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:18.086664 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-1597a435-edc2-4a12-a581-e6b0791dcb73 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:18.098040 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1597a435-edc2-4a12-a581-e6b0791dcb73 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:18.098754 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1597a435-edc2-4a12-a581-e6b0791dcb73 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:18.099909 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1597a435-edc2-4a12-a581-e6b0791dcb73 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:18.100440 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1597a435-edc2-4a12-a581-e6b0791dcb73 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:18.347139 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1597a435-edc2-4a12-a581-e6b0791dcb73 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:18.351804 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:18.366763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-1597a435-edc2-4a12-a581-e6b0791dcb73 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.286481 May 23 15:34:18.367354 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 305/602] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:18 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:18.436539 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b082bc8d-9ad5-4065-92f7-ce143aa763b9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:18.438457 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b082bc8d-9ad5-4065-92f7-ce143aa763b9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:18.447091 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b082bc8d-9ad5-4065-92f7-ce143aa763b9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:18.447560 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b082bc8d-9ad5-4065-92f7-ce143aa763b9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:18.448347 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b082bc8d-9ad5-4065-92f7-ce143aa763b9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:18.448794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b082bc8d-9ad5-4065-92f7-ce143aa763b9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:18.481137 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b082bc8d-9ad5-4065-92f7-ce143aa763b9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050474 May 23 15:34:18.481705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 298/603] 10.222.0.30 () {60 vars in 1342 bytes} [Mon May 23 15:34:18 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:18.543843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8fe56f16-e758-43a5-b943-5314eace576a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:18.544338 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8fe56f16-e758-43a5-b943-5314eace576a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:18.551562 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8fe56f16-e758-43a5-b943-5314eace576a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:18.552256 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8fe56f16-e758-43a5-b943-5314eace576a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:18.553069 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8fe56f16-e758-43a5-b943-5314eace576a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:18.553506 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8fe56f16-e758-43a5-b943-5314eace576a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:18.581755 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8fe56f16-e758-43a5-b943-5314eace576a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Going to try to terminate instance {{(pid=117974) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:34:18.679773 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8fe56f16-e758-43a5-b943-5314eace576a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 204 len: 0 microversion: 2.20 time: 0.139518 May 23 15:34:18.680827 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 306/604] 10.222.0.30 () {60 vars in 1279 bytes} [Mon May 23 15:34:18 2022] DELETE /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 15:34:18.689766 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-31824fe1-0712-4e9c-86ca-3149e1ac6399 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:18.690686 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-31824fe1-0712-4e9c-86ca-3149e1ac6399 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:18.697219 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-31824fe1-0712-4e9c-86ca-3149e1ac6399 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:18.697679 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-31824fe1-0712-4e9c-86ca-3149e1ac6399 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:18.698653 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-31824fe1-0712-4e9c-86ca-3149e1ac6399 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:18.699102 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-31824fe1-0712-4e9c-86ca-3149e1ac6399 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:18.834036 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-31824fe1-0712-4e9c-86ca-3149e1ac6399 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:18.842248 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-31824fe1-0712-4e9c-86ca-3149e1ac6399 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:18.843757 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-31824fe1-0712-4e9c-86ca-3149e1ac6399 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:18.844925 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-31824fe1-0712-4e9c-86ca-3149e1ac6399 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.159625 May 23 15:34:18.845483 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 299/605] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:34:18 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:34:19.385321 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-07659a5f-2a23-4e2a-820b-40ee2ebce107 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:19.386035 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-07659a5f-2a23-4e2a-820b-40ee2ebce107 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:19.392381 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-07659a5f-2a23-4e2a-820b-40ee2ebce107 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:19.392840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-07659a5f-2a23-4e2a-820b-40ee2ebce107 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:19.393640 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-07659a5f-2a23-4e2a-820b-40ee2ebce107 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:19.394083 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-07659a5f-2a23-4e2a-820b-40ee2ebce107 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:19.526214 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-07659a5f-2a23-4e2a-820b-40ee2ebce107 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:19.534415 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-07659a5f-2a23-4e2a-820b-40ee2ebce107 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.153368 May 23 15:34:19.534987 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 307/606] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:19 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:19.863906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-88da1c01-0385-4dda-adda-478426034f88 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:19.864451 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-88da1c01-0385-4dda-adda-478426034f88 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:19.871430 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-88da1c01-0385-4dda-adda-478426034f88 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:19.871891 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-88da1c01-0385-4dda-adda-478426034f88 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:19.873379 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-88da1c01-0385-4dda-adda-478426034f88 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:19.874011 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-88da1c01-0385-4dda-adda-478426034f88 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:20.009848 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-88da1c01-0385-4dda-adda-478426034f88 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:20.018023 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-88da1c01-0385-4dda-adda-478426034f88 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:20.019586 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-88da1c01-0385-4dda-adda-478426034f88 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:20.020766 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-88da1c01-0385-4dda-adda-478426034f88 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.160856 May 23 15:34:20.021361 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 300/607] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:34:19 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:34:20.551131 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8c5c2d0c-8ad8-4a69-9072-cb6be224e0fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:20.551743 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8c5c2d0c-8ad8-4a69-9072-cb6be224e0fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:20.558188 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8c5c2d0c-8ad8-4a69-9072-cb6be224e0fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:20.558628 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8c5c2d0c-8ad8-4a69-9072-cb6be224e0fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:20.559381 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8c5c2d0c-8ad8-4a69-9072-cb6be224e0fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:20.559816 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8c5c2d0c-8ad8-4a69-9072-cb6be224e0fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:20.769413 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-8c5c2d0c-8ad8-4a69-9072-cb6be224e0fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:20.777307 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8c5c2d0c-8ad8-4a69-9072-cb6be224e0fc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.229995 May 23 15:34:20.777870 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 308/608] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:20 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:21.040677 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-cfc91e53-b528-4d32-beec-d07b4a68dc6f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:21.041329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-cfc91e53-b528-4d32-beec-d07b4a68dc6f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:21.048751 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cfc91e53-b528-4d32-beec-d07b4a68dc6f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:21.049279 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cfc91e53-b528-4d32-beec-d07b4a68dc6f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:21.050124 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cfc91e53-b528-4d32-beec-d07b4a68dc6f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:21.050616 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cfc91e53-b528-4d32-beec-d07b4a68dc6f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:21.181534 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-cfc91e53-b528-4d32-beec-d07b4a68dc6f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:21.190483 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-cfc91e53-b528-4d32-beec-d07b4a68dc6f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:21.192113 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-cfc91e53-b528-4d32-beec-d07b4a68dc6f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:21.193350 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-cfc91e53-b528-4d32-beec-d07b4a68dc6f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 200 len: 1724 microversion: 2.20 time: 0.157030 May 23 15:34:21.194285 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 301/609] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:34:21 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:34:21.503392 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-b67cf891-3009-4ca8-9105-52359a5e3bb8 req-9ff167e1-d3a6-46b2-91c5-3bc3571a451a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9038c8-1395-4d48-b10b-2fe7310c4c76", "name": "network-vif-deleted", "tag": "920328ed-01fa-4ed4-b496-7b1fea54b54c"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:21.513345 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-b67cf891-3009-4ca8-9105-52359a5e3bb8 req-9ff167e1-d3a6-46b2-91c5-3bc3571a451a service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:21.513880 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-b67cf891-3009-4ca8-9105-52359a5e3bb8 req-9ff167e1-d3a6-46b2-91c5-3bc3571a451a service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:21.526806 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-b67cf891-3009-4ca8-9105-52359a5e3bb8 req-9ff167e1-d3a6-46b2-91c5-3bc3571a451a service nova] Creating event network-vif-deleted:920328ed-01fa-4ed4-b496-7b1fea54b54c for instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 on hv-cinder-84112 May 23 15:34:21.532731 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-b67cf891-3009-4ca8-9105-52359a5e3bb8 req-9ff167e1-d3a6-46b2-91c5-3bc3571a451a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033175 May 23 15:34:21.533663 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 309/610] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:21.795179 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-79376882-368e-4037-97e1-726e98f8f8e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:21.795877 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-79376882-368e-4037-97e1-726e98f8f8e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:21.802207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-79376882-368e-4037-97e1-726e98f8f8e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:21.802664 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-79376882-368e-4037-97e1-726e98f8f8e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:21.803472 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-79376882-368e-4037-97e1-726e98f8f8e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:21.803916 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-79376882-368e-4037-97e1-726e98f8f8e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:21.935165 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-79376882-368e-4037-97e1-726e98f8f8e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:21.943300 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-79376882-368e-4037-97e1-726e98f8f8e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.151989 May 23 15:34:21.943878 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 302/611] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:21 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:22.212402 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3413050d-c810-4625-bca0-cf8f58f8e618 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:22.213180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3413050d-c810-4625-bca0-cf8f58f8e618 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:22.220557 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3413050d-c810-4625-bca0-cf8f58f8e618 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:22.221076 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3413050d-c810-4625-bca0-cf8f58f8e618 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:22.221850 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3413050d-c810-4625-bca0-cf8f58f8e618 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:22.222288 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3413050d-c810-4625-bca0-cf8f58f8e618 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:22.236149 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-3413050d-c810-4625-bca0-cf8f58f8e618 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] HTTP exception thrown: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3413050d-c810-4625-bca0-cf8f58f8e618 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Request method failure captured: May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 HTTP/1.1 May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6h7s93EUFTHH07GUtw7-KYlZcG2k5tn9NZXL-nM0vj9t2FDkMEGbp0CLOojSRZCdsEKs6sa_HKuxdYoalFRi9y70FqzlViDvtDjOKBi9ngSmF2FQhslV0e39s2WA0JMDBk-c1-9a08ZgrMFnb-XgArIjf-fBYY68rjwO_VDuxn2vS8 May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Openstack-Nova-Api-Version: 2.20 May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 65c6b1563c424330ade1ef15f8efa110 May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:34:22.238005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:34:22.239671 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_65c6b1563c424330ade1ef15f8efa110", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:34:22.239671 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:34:22.239671 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 65c6b1563c424330ade1ef15f8efa110 May 23 15:34:22.239671 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:34:22.239671 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-AttachVolumeShelveTestJSON-1032588577-project May 23 15:34:22.239671 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:34:22.239671 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:34:22.239671 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 139e3e42acff4c4ca8df0a7c4fc81053 May 23 15:34:22.239671 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1032588577-project May 23 15:34:22.239671 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:34:22.239671 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. May 23 15:34:22.239671 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '9b9038c8-1395-4d48-b10b-2fe7310c4c76'} May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:34:22.240584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. May 23 15:34:22.242052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:34:22.243308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3413050d-c810-4625-bca0-cf8f58f8e618 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Returning 404 to user: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:34:22.243308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3413050d-c810-4625-bca0-cf8f58f8e618 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 404 len: 111 microversion: 2.20 time: 0.031457 May 23 15:34:22.243308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 310/612] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:34:22 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 15:34:22.249250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-df7967ad-dfa7-4391-9870-62e92f3a2b81 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '.version_select at 0x7f0d7a31f550>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:22.269232 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-df7967ad-dfa7-4391-9870-62e92f3a2b81 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2078259863" status: 204 len: 0 microversion: 2.20 time: 0.024337 May 23 15:34:22.269820 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 303/613] 10.222.0.30 () {60 vars in 1261 bytes} [Mon May 23 15:34:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2078259863 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 15:34:22.909655 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b7c800bc-2476-4d6e-b75d-1a75755cbc3f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Action: 'create', calling method: .version_select at 0x7f0d7a41faf0>, body: {"keypair": {"name": "tempest-keypair-1001319890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhkXRhkgiM3CJQFIynqBjEbvn/fy+52JHy7it5XxGXHV0N4Eqn9Vma9+sXJPGPfEVfJ5lsiD6DocyirW2e1A6uuN5LS8omy25K3gIZdB1bwwVAWLRKoRjvympEK+JkSmQ=="}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:22.927587 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-b7c800bc-2476-4d6e-b75d-1a75755cbc3f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Getting quotas for project 65c6b1563c424330ade1ef15f8efa110. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:34:22.932212 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-b7c800bc-2476-4d6e-b75d-1a75755cbc3f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Getting quotas for user 139e3e42acff4c4ca8df0a7c4fc81053 and project 65c6b1563c424330ade1ef15f8efa110. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:34:22.956263 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b7c800bc-2476-4d6e-b75d-1a75755cbc3f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050479 May 23 15:34:22.956887 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 311/614] 10.222.0.30 () {62 vars in 1199 bytes} [Mon May 23 15:34:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 23 15:34:22.960686 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f9d87c69-2b0b-4c2b-9303-42ba3833b2a7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:22.961332 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f9d87c69-2b0b-4c2b-9303-42ba3833b2a7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:22.967664 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f9d87c69-2b0b-4c2b-9303-42ba3833b2a7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:22.967995 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f9d87c69-2b0b-4c2b-9303-42ba3833b2a7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:22.968768 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f9d87c69-2b0b-4c2b-9303-42ba3833b2a7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:22.969236 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f9d87c69-2b0b-4c2b-9303-42ba3833b2a7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:23.156197 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f9d87c69-2b0b-4c2b-9303-42ba3833b2a7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:23.164399 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f9d87c69-2b0b-4c2b-9303-42ba3833b2a7 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.207895 May 23 15:34:23.165091 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 304/615] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:22 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:34:24.181851 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5e693977-d75e-4b4e-9339-00854042fff2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:24.182553 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-5e693977-d75e-4b4e-9339-00854042fff2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:24.190291 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5e693977-d75e-4b4e-9339-00854042fff2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:24.190746 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5e693977-d75e-4b4e-9339-00854042fff2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:24.191526 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5e693977-d75e-4b4e-9339-00854042fff2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:24.192008 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5e693977-d75e-4b4e-9339-00854042fff2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:24.309462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-86428f8c-abba-4be0-b4c4-93fec460c8c8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-977120770", "imageRef": "807d39e3-2293-48ca-b2cd-675f7c931014", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "751cbaf0-d17b-4cd8-950f-078d51e9414f"}], "security_groups": [{"name": "tempest-securitygroup--1126252211"}], "key_name": "tempest-keypair-1001319890", "user_data": "}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:24.330086 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-5e693977-d75e-4b4e-9339-00854042fff2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:24.338157 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5e693977-d75e-4b4e-9339-00854042fff2 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.160275 May 23 15:34:24.338763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 312/616] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:24 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:24.409144 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.network.neutron [None req-86428f8c-abba-4be0-b4c4-93fec460c8c8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] validate_networks() for [('751cbaf0-d17b-4cd8-950f-078d51e9414f', None, None, None, None, None)] {{(pid=117973) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:34:24.764052 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-86428f8c-abba-4be0-b4c4-93fec460c8c8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Flavor limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:34:24.764485 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-86428f8c-abba-4be0-b4c4-93fec460c8c8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Image limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:34:24.765048 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-86428f8c-abba-4be0-b4c4-93fec460c8c8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Flavor pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:34:24.765471 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-86428f8c-abba-4be0-b4c4-93fec460c8c8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Image pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:34:24.765897 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-86428f8c-abba-4be0-b4c4-93fec460c8c8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:34:24.774944 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86428f8c-abba-4be0-b4c4-93fec460c8c8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:24.775403 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86428f8c-abba-4be0-b4c4-93fec460c8c8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:24.776213 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86428f8c-abba-4be0-b4c4-93fec460c8c8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:24.776656 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86428f8c-abba-4be0-b4c4-93fec460c8c8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:24.793371 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-86428f8c-abba-4be0-b4c4-93fec460c8c8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Getting quotas for project 65c6b1563c424330ade1ef15f8efa110. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:34:24.798068 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-86428f8c-abba-4be0-b4c4-93fec460c8c8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Getting quotas for user 139e3e42acff4c4ca8df0a7c4fc81053 and project 65c6b1563c424330ade1ef15f8efa110. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:34:24.809101 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-86428f8c-abba-4be0-b4c4-93fec460c8c8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Going to run 1 instances... {{(pid=117973) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:34:24.812110 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-86428f8c-abba-4be0-b4c4-93fec460c8c8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='807d39e3-2293-48ca-b2cd-675f7c931014',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:34:24.859444 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-86428f8c-abba-4be0-b4c4-93fec460c8c8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.554455 May 23 15:34:24.860095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 305/617] 10.222.0.30 () {62 vars in 1187 bytes} [Mon May 23 15:34:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 23 15:34:24.870263 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-18220aa6-5059-4b28-972f-02dabef20b5b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:24.870881 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-18220aa6-5059-4b28-972f-02dabef20b5b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:24.925424 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-18220aa6-5059-4b28-972f-02dabef20b5b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:24.932633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-18220aa6-5059-4b28-972f-02dabef20b5b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:24.934793 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-18220aa6-5059-4b28-972f-02dabef20b5b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:24.937198 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-18220aa6-5059-4b28-972f-02dabef20b5b tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1281 microversion: 2.20 time: 0.070697 May 23 15:34:24.937627 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 313/618] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:34:24 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:34:25.355668 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b2696672-4ed2-4522-ab05-f1862344c5a0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:25.356292 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b2696672-4ed2-4522-ab05-f1862344c5a0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:25.362907 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b2696672-4ed2-4522-ab05-f1862344c5a0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:25.363364 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b2696672-4ed2-4522-ab05-f1862344c5a0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:25.364136 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b2696672-4ed2-4522-ab05-f1862344c5a0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:25.364582 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b2696672-4ed2-4522-ab05-f1862344c5a0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:25.495634 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b2696672-4ed2-4522-ab05-f1862344c5a0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:25.504466 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b2696672-4ed2-4522-ab05-f1862344c5a0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.152749 May 23 15:34:25.505052 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 306/619] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:25 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:34:25.955125 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-9393b17f-f24a-4747-8f07-969445ca71b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:25.956624 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-9393b17f-f24a-4747-8f07-969445ca71b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:25.964162 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9393b17f-f24a-4747-8f07-969445ca71b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:25.964616 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9393b17f-f24a-4747-8f07-969445ca71b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:25.965639 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9393b17f-f24a-4747-8f07-969445ca71b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:25.966236 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9393b17f-f24a-4747-8f07-969445ca71b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:26.005427 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f9afd127-b450-464b-86bb-968717068f6a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-597829521"}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:26.005686 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f9afd127-b450-464b-86bb-968717068f6a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:26.012076 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f9afd127-b450-464b-86bb-968717068f6a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:26.012538 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f9afd127-b450-464b-86bb-968717068f6a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:26.014121 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f9afd127-b450-464b-86bb-968717068f6a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:26.014571 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f9afd127-b450-464b-86bb-968717068f6a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:26.046334 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9393b17f-f24a-4747-8f07-969445ca71b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:26.056030 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9393b17f-f24a-4747-8f07-969445ca71b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:26.058632 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9393b17f-f24a-4747-8f07-969445ca71b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:26.060031 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-9393b17f-f24a-4747-8f07-969445ca71b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1341 microversion: 2.20 time: 0.109650 May 23 15:34:26.061219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 314/620] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:34:25 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1341 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:34:26.166825 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.network.security_group_api [None req-f9afd127-b450-464b-86bb-968717068f6a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Removing security group 97c8001c-8396-4cb5-abd4-1d2093ab8c66 from port d674721e-f3c3-41d6-99a3-5276229c8c17 May 23 15:34:26.522889 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-bc5042e8-5631-4a50-95b9-efd5545891e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:26.523999 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-bc5042e8-5631-4a50-95b9-efd5545891e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:26.531306 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bc5042e8-5631-4a50-95b9-efd5545891e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:26.531772 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bc5042e8-5631-4a50-95b9-efd5545891e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:26.532676 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bc5042e8-5631-4a50-95b9-efd5545891e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:26.533179 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bc5042e8-5631-4a50-95b9-efd5545891e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:26.752677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-bc5042e8-5631-4a50-95b9-efd5545891e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:26.763242 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-bc5042e8-5631-4a50-95b9-efd5545891e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.244762 May 23 15:34:26.775535 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 315/621] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:26 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:34:26.796082 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f9afd127-b450-464b-86bb-968717068f6a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "POST /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/action" status: 202 len: 0 microversion: 2.1 time: 0.795639 May 23 15:34:26.797440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 307/622] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 15:34:25 2022] POST /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/action => generated 0 bytes in 797 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:34:26.817352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-12bd8352-0d98-4aa9-bea9-67e4df9bc61f req-fa4b5b7b-5af2-45b0-a48b-732854021827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55f39cba-5943-42d5-9322-58f3af0d39f8", "tag": "d674721e-f3c3-41d6-99a3-5276229c8c17"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:26.863046 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-12bd8352-0d98-4aa9-bea9-67e4df9bc61f req-fa4b5b7b-5af2-45b0-a48b-732854021827 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:26.877090 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-12bd8352-0d98-4aa9-bea9-67e4df9bc61f req-fa4b5b7b-5af2-45b0-a48b-732854021827 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:26.906235 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-12bd8352-0d98-4aa9-bea9-67e4df9bc61f req-fa4b5b7b-5af2-45b0-a48b-732854021827 service nova] Creating event network-changed:d674721e-f3c3-41d6-99a3-5276229c8c17 for instance 55f39cba-5943-42d5-9322-58f3af0d39f8 on hv-cinder-84112 May 23 15:34:26.918261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-12bd8352-0d98-4aa9-bea9-67e4df9bc61f req-fa4b5b7b-5af2-45b0-a48b-732854021827 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110234 May 23 15:34:26.920435 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 316/623] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:27.079563 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-98737175-458f-445c-b209-b5d87b524900 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:27.080474 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-98737175-458f-445c-b209-b5d87b524900 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:27.083009 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:27.099935 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-98737175-458f-445c-b209-b5d87b524900 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:27.100805 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-98737175-458f-445c-b209-b5d87b524900 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:27.101689 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-98737175-458f-445c-b209-b5d87b524900 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:27.102132 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-98737175-458f-445c-b209-b5d87b524900 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:27.497186 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-98737175-458f-445c-b209-b5d87b524900 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:27.509498 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-98737175-458f-445c-b209-b5d87b524900 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:27.511661 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-98737175-458f-445c-b209-b5d87b524900 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:27.514271 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-98737175-458f-445c-b209-b5d87b524900 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1407 microversion: 2.20 time: 0.438727 May 23 15:34:27.520967 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 308/624] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:34:27 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:34:27.785836 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e9b07caa-d0d4-4a43-b2fe-9cd392f9d392 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:27.787287 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e9b07caa-d0d4-4a43-b2fe-9cd392f9d392 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:27.798541 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e9b07caa-d0d4-4a43-b2fe-9cd392f9d392 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:27.799281 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e9b07caa-d0d4-4a43-b2fe-9cd392f9d392 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:27.800255 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e9b07caa-d0d4-4a43-b2fe-9cd392f9d392 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:27.800855 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e9b07caa-d0d4-4a43-b2fe-9cd392f9d392 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:28.021171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e9b07caa-d0d4-4a43-b2fe-9cd392f9d392 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:28.047145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e9b07caa-d0d4-4a43-b2fe-9cd392f9d392 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.269137 May 23 15:34:28.048948 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 317/625] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:27 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:28.087027 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-837a7e05-1114-4e11-9ead-bf1c681dbcb9 req-f1ffc65d-0f5c-4a8d-b9c7-f53f6b8eadde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5c3bd6-1b7d-4c25-a705-2291f6709285", "tag": "1163c3a8-18a2-4093-9e90-731d856e8076"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:28.118407 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-837a7e05-1114-4e11-9ead-bf1c681dbcb9 req-f1ffc65d-0f5c-4a8d-b9c7-f53f6b8eadde service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:28.119050 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-837a7e05-1114-4e11-9ead-bf1c681dbcb9 req-f1ffc65d-0f5c-4a8d-b9c7-f53f6b8eadde service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:28.140931 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-837a7e05-1114-4e11-9ead-bf1c681dbcb9 req-f1ffc65d-0f5c-4a8d-b9c7-f53f6b8eadde service nova] Creating event network-changed:1163c3a8-18a2-4093-9e90-731d856e8076 for instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 on hv-cinder-84112 May 23 15:34:28.147393 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-837a7e05-1114-4e11-9ead-bf1c681dbcb9 req-f1ffc65d-0f5c-4a8d-b9c7-f53f6b8eadde service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064855 May 23 15:34:28.149186 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 309/626] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:28.533409 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-aeee208e-30a5-494d-9710-3f96d2f176de tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:28.534874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-aeee208e-30a5-494d-9710-3f96d2f176de tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:28.541794 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aeee208e-30a5-494d-9710-3f96d2f176de tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:28.542479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aeee208e-30a5-494d-9710-3f96d2f176de tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:28.543445 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aeee208e-30a5-494d-9710-3f96d2f176de tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:28.544071 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-aeee208e-30a5-494d-9710-3f96d2f176de tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:28.570944 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d9a3f02b-c145-4e8d-9ee0-6c5d2952da86 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:28.571631 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d9a3f02b-c145-4e8d-9ee0-6c5d2952da86 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:28.579718 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d9a3f02b-c145-4e8d-9ee0-6c5d2952da86 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:28.580287 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d9a3f02b-c145-4e8d-9ee0-6c5d2952da86 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:28.581199 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d9a3f02b-c145-4e8d-9ee0-6c5d2952da86 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:28.581712 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d9a3f02b-c145-4e8d-9ee0-6c5d2952da86 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:28.714400 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-aeee208e-30a5-494d-9710-3f96d2f176de tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:28.735579 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.objects.instance [None req-d9a3f02b-c145-4e8d-9ee0-6c5d2952da86 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lazy-loading 'services' on Instance uuid 55f39cba-5943-42d5-9322-58f3af0d39f8 {{(pid=117973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:34:28.735838 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-aeee208e-30a5-494d-9710-3f96d2f176de tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:28.737650 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-aeee208e-30a5-494d-9710-3f96d2f176de tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:28.738790 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-aeee208e-30a5-494d-9710-3f96d2f176de tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1407 microversion: 2.20 time: 0.209950 May 23 15:34:28.739351 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 318/627] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:34:28 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:34:28.858157 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d9a3f02b-c145-4e8d-9ee0-6c5d2952da86 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "DELETE /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/os-volume_attachments/7b2744bd-ab28-4f02-a5a0-9a762151d575" status: 202 len: 0 microversion: 2.1 time: 0.292154 May 23 15:34:28.858755 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 310/628] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 15:34:28 2022] DELETE /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/os-volume_attachments/7b2744bd-ab28-4f02-a5a0-9a762151d575 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:34:28.867382 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-391855ba-3d38-4038-999e-ed587b1714d3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:28.868390 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-391855ba-3d38-4038-999e-ed587b1714d3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:28.875417 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-391855ba-3d38-4038-999e-ed587b1714d3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:28.875946 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-391855ba-3d38-4038-999e-ed587b1714d3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:28.876825 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-391855ba-3d38-4038-999e-ed587b1714d3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:28.877316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-391855ba-3d38-4038-999e-ed587b1714d3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:28.909078 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-391855ba-3d38-4038-999e-ed587b1714d3 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045887 May 23 15:34:28.909671 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 319/629] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:34:28 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:28.939150 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-bc8ca1dc-624d-47e2-a070-807af2fc98c1 req-b3c7cfc7-5232-43c0-9611-12c6b1ec22e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55f39cba-5943-42d5-9322-58f3af0d39f8", "tag": "d674721e-f3c3-41d6-99a3-5276229c8c17"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:28.948094 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-bc8ca1dc-624d-47e2-a070-807af2fc98c1 req-b3c7cfc7-5232-43c0-9611-12c6b1ec22e0 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:28.948545 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-bc8ca1dc-624d-47e2-a070-807af2fc98c1 req-b3c7cfc7-5232-43c0-9611-12c6b1ec22e0 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:28.960735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-bc8ca1dc-624d-47e2-a070-807af2fc98c1 req-b3c7cfc7-5232-43c0-9611-12c6b1ec22e0 service nova] Creating event network-changed:d674721e-f3c3-41d6-99a3-5276229c8c17 for instance 55f39cba-5943-42d5-9322-58f3af0d39f8 on hv-cinder-84112 May 23 15:34:28.965573 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-bc8ca1dc-624d-47e2-a070-807af2fc98c1 req-b3c7cfc7-5232-43c0-9611-12c6b1ec22e0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031498 May 23 15:34:28.966170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 311/630] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:29.064577 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-0b117bcf-4109-4f7d-a5a2-90563b0d8a32 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:29.065230 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-0b117bcf-4109-4f7d-a5a2-90563b0d8a32 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:29.071280 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0b117bcf-4109-4f7d-a5a2-90563b0d8a32 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:29.071732 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0b117bcf-4109-4f7d-a5a2-90563b0d8a32 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:29.072508 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0b117bcf-4109-4f7d-a5a2-90563b0d8a32 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:29.073053 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0b117bcf-4109-4f7d-a5a2-90563b0d8a32 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:29.207457 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0b117bcf-4109-4f7d-a5a2-90563b0d8a32 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:29.215342 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-0b117bcf-4109-4f7d-a5a2-90563b0d8a32 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.155264 May 23 15:34:29.215996 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 320/631] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:29 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:29.765632 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3b4e708f-b6d6-4e8e-8037-67e7329c97f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:29.767400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-3b4e708f-b6d6-4e8e-8037-67e7329c97f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:29.776185 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3b4e708f-b6d6-4e8e-8037-67e7329c97f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:29.776602 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3b4e708f-b6d6-4e8e-8037-67e7329c97f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:29.777581 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3b4e708f-b6d6-4e8e-8037-67e7329c97f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:29.778204 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3b4e708f-b6d6-4e8e-8037-67e7329c97f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:29.920894 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-7f04a523-c12a-4c32-9879-2d79458ac501 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:29.921837 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-7f04a523-c12a-4c32-9879-2d79458ac501 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:29.928353 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7f04a523-c12a-4c32-9879-2d79458ac501 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:29.928811 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7f04a523-c12a-4c32-9879-2d79458ac501 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:29.929709 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7f04a523-c12a-4c32-9879-2d79458ac501 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:29.930092 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7f04a523-c12a-4c32-9879-2d79458ac501 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:29.959504 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-7f04a523-c12a-4c32-9879-2d79458ac501 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042586 May 23 15:34:29.960075 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 321/632] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:34:29 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:34:29.964965 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3b4e708f-b6d6-4e8e-8037-67e7329c97f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:29.973571 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3b4e708f-b6d6-4e8e-8037-67e7329c97f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:29.975077 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3b4e708f-b6d6-4e8e-8037-67e7329c97f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:29.976178 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-3b4e708f-b6d6-4e8e-8037-67e7329c97f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1407 microversion: 2.20 time: 0.217508 May 23 15:34:29.976770 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 312/633] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:34:29 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:34:30.233259 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5a228646-1d79-4dfa-9596-cc5674385484 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:30.233789 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-5a228646-1d79-4dfa-9596-cc5674385484 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:30.240227 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5a228646-1d79-4dfa-9596-cc5674385484 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:30.240684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5a228646-1d79-4dfa-9596-cc5674385484 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:30.241500 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5a228646-1d79-4dfa-9596-cc5674385484 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:30.241943 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5a228646-1d79-4dfa-9596-cc5674385484 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:30.385561 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-5a228646-1d79-4dfa-9596-cc5674385484 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:30.397721 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5a228646-1d79-4dfa-9596-cc5674385484 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.168526 May 23 15:34:30.398624 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 322/634] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:30 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:30.971364 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ec307e2f-ac88-4e6b-a107-7437280e4f66 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:30.972241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ec307e2f-ac88-4e6b-a107-7437280e4f66 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:30.978736 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ec307e2f-ac88-4e6b-a107-7437280e4f66 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:30.979186 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ec307e2f-ac88-4e6b-a107-7437280e4f66 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:30.979948 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ec307e2f-ac88-4e6b-a107-7437280e4f66 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:30.980387 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ec307e2f-ac88-4e6b-a107-7437280e4f66 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:30.994343 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2d79c235-609e-402e-a3e7-3abaa48bf70d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:30.994948 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-2d79c235-609e-402e-a3e7-3abaa48bf70d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:31.002067 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2d79c235-609e-402e-a3e7-3abaa48bf70d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:31.002510 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2d79c235-609e-402e-a3e7-3abaa48bf70d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:31.003273 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2d79c235-609e-402e-a3e7-3abaa48bf70d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:31.003712 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2d79c235-609e-402e-a3e7-3abaa48bf70d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:31.009731 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ec307e2f-ac88-4e6b-a107-7437280e4f66 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042513 May 23 15:34:31.010295 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 313/635] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:34:30 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:34:31.019860 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8e2ce95d-8ba2-4b7e-af1f-4ef312976cf9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:31.020356 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8e2ce95d-8ba2-4b7e-af1f-4ef312976cf9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:31.026174 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8e2ce95d-8ba2-4b7e-af1f-4ef312976cf9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:31.026630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8e2ce95d-8ba2-4b7e-af1f-4ef312976cf9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:31.027434 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8e2ce95d-8ba2-4b7e-af1f-4ef312976cf9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:31.027870 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8e2ce95d-8ba2-4b7e-af1f-4ef312976cf9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:31.043157 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:31.110632 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-8e2ce95d-8ba2-4b7e-af1f-4ef312976cf9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] HTTP exception thrown: Instance 55f39cba-5943-42d5-9322-58f3af0d39f8 is not attached to volume 7b2744bd-ab28-4f02-a5a0-9a762151d575 May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8e2ce95d-8ba2-4b7e-af1f-4ef312976cf9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Request method failure captured: May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: DELETE /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/os-volume_attachments/7b2744bd-ab28-4f02-a5a0-9a762151d575 HTTP/1.1 May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6jOWth3ODDWEW3YTsJiAXEH3WeFBczpGQyVNe9ft91Sig6d3LbY3avsiXSKlkieqDApEvSck2UjwzLOQYx4ZDbkK7CoSKN0xbD2xIqPV70-ojEvuOgM5xj5IWFQ5dZzASwEN4qyqBYAHx2a3CwtnvlyAQzsy3sV-W9mBo0zNykj7_M May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: 591802cf5c044932940307866f388790 May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-TestMinimumBasicScenario-582055684 May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:34:31.118650 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:34:31.120034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/591802cf5c044932940307866f388790"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/591802cf5c044932940307866f388790"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/591802cf5c044932940307866f388790"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_591802cf5c044932940307866f388790", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:34:31.120034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-TestMinimumBasicScenario-582055684 May 23 15:34:31.120034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: 591802cf5c044932940307866f388790 May 23 15:34:31.120034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-TestMinimumBasicScenario-582055684 May 23 15:34:31.120034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-TestMinimumBasicScenario-582055684-project May 23 15:34:31.120034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:34:31.120034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:34:31.120034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: ceed468da0c844b688f5f91768b0dd96 May 23 15:34:31.120034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-TestMinimumBasicScenario-582055684-project May 23 15:34:31.120034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:34:31.120034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance 55f39cba-5943-42d5-9322-58f3af0d39f8 is not attached to volume 7b2744bd-ab28-4f02-a5a0-9a762151d575 May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'server_id': '55f39cba-5943-42d5-9322-58f3af0d39f8', 'id': '7b2744bd-ab28-4f02-a5a0-9a762151d575'} May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7b2744bd-ab28-4f02-a5a0-9a762151d575. May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:34:31.120830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:34:31.122201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:31.122201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 23 15:34:31.122201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 23 15:34:31.122201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f39cba-5943-42d5-9322-58f3af0d39f8 is not attached to volume 7b2744bd-ab28-4f02-a5a0-9a762151d575 May 23 15:34:31.122201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:31.122201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:31.122201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:31.122201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:31.122201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:31.122201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:31.122201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:34:31.122201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:34:31.122201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f39cba-5943-42d5-9322-58f3af0d39f8 is not attached to volume 7b2744bd-ab28-4f02-a5a0-9a762151d575 May 23 15:34:31.122201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:31.122201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8e2ce95d-8ba2-4b7e-af1f-4ef312976cf9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Returning 404 to user: Instance 55f39cba-5943-42d5-9322-58f3af0d39f8 is not attached to volume 7b2744bd-ab28-4f02-a5a0-9a762151d575 {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:34:31.124254 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8e2ce95d-8ba2-4b7e-af1f-4ef312976cf9 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "DELETE /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/os-volume_attachments/7b2744bd-ab28-4f02-a5a0-9a762151d575" status: 404 len: 154 microversion: 2.1 time: 0.105108 May 23 15:34:31.124254 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 314/636] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 15:34:31 2022] DELETE /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8/os-volume_attachments/7b2744bd-ab28-4f02-a5a0-9a762151d575 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:34:31.137815 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-2d79c235-609e-402e-a3e7-3abaa48bf70d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:31.145967 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-2d79c235-609e-402e-a3e7-3abaa48bf70d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:31.147460 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-2d79c235-609e-402e-a3e7-3abaa48bf70d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:31.148562 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-2d79c235-609e-402e-a3e7-3abaa48bf70d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1407 microversion: 2.20 time: 0.158204 May 23 15:34:31.149173 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 323/637] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:34:30 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:34:31.414952 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ff18ceae-3d98-4750-8c7c-7a64eecfa48c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:31.415572 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ff18ceae-3d98-4750-8c7c-7a64eecfa48c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:31.421655 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ff18ceae-3d98-4750-8c7c-7a64eecfa48c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:31.422113 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ff18ceae-3d98-4750-8c7c-7a64eecfa48c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:31.422884 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ff18ceae-3d98-4750-8c7c-7a64eecfa48c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:31.423331 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ff18ceae-3d98-4750-8c7c-7a64eecfa48c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:31.564330 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ff18ceae-3d98-4750-8c7c-7a64eecfa48c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:31.572373 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ff18ceae-3d98-4750-8c7c-7a64eecfa48c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.161477 May 23 15:34:31.572957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 315/638] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:31 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:34:32.166728 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-64532cbb-c4a1-4013-b7c3-5abe80cf35c6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:32.167264 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-64532cbb-c4a1-4013-b7c3-5abe80cf35c6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:32.174464 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-64532cbb-c4a1-4013-b7c3-5abe80cf35c6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:32.174920 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-64532cbb-c4a1-4013-b7c3-5abe80cf35c6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:32.175693 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-64532cbb-c4a1-4013-b7c3-5abe80cf35c6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:32.176140 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-64532cbb-c4a1-4013-b7c3-5abe80cf35c6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:32.256721 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b4e1fe1a-40e6-49de-89d3-83af211ade9a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:32.257259 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b4e1fe1a-40e6-49de-89d3-83af211ade9a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:32.263851 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b4e1fe1a-40e6-49de-89d3-83af211ade9a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:32.264308 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b4e1fe1a-40e6-49de-89d3-83af211ade9a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:32.265145 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b4e1fe1a-40e6-49de-89d3-83af211ade9a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:32.265592 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b4e1fe1a-40e6-49de-89d3-83af211ade9a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:32.292341 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b4e1fe1a-40e6-49de-89d3-83af211ade9a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Going to try to terminate instance {{(pid=117973) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:34:32.310901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-64532cbb-c4a1-4013-b7c3-5abe80cf35c6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:32.313523 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:32.323961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-64532cbb-c4a1-4013-b7c3-5abe80cf35c6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:32.325514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-64532cbb-c4a1-4013-b7c3-5abe80cf35c6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:32.326862 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-64532cbb-c4a1-4013-b7c3-5abe80cf35c6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1407 microversion: 2.20 time: 0.164381 May 23 15:34:32.327796 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 324/639] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:34:32 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:34:32.375229 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b4e1fe1a-40e6-49de-89d3-83af211ade9a tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "DELETE /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 204 len: 0 microversion: 2.1 time: 0.121946 May 23 15:34:32.376153 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 316/640] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:34:32 2022] DELETE /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 15:34:32.384381 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-eda3c79d-c8a2-4d33-96e8-f70f7bd6471f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:32.385033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-eda3c79d-c8a2-4d33-96e8-f70f7bd6471f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:32.393493 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eda3c79d-c8a2-4d33-96e8-f70f7bd6471f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:32.393952 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eda3c79d-c8a2-4d33-96e8-f70f7bd6471f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:32.394724 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eda3c79d-c8a2-4d33-96e8-f70f7bd6471f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:32.395181 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eda3c79d-c8a2-4d33-96e8-f70f7bd6471f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:32.524436 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-eda3c79d-c8a2-4d33-96e8-f70f7bd6471f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:32.532414 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-eda3c79d-c8a2-4d33-96e8-f70f7bd6471f tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1553 microversion: 2.1 time: 0.151974 May 23 15:34:32.532999 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 325/641] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:32 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:32.590159 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7c962a3e-a8b2-43ac-a527-81cd24179a04 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:32.590899 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7c962a3e-a8b2-43ac-a527-81cd24179a04 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:32.597594 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7c962a3e-a8b2-43ac-a527-81cd24179a04 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:32.598048 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7c962a3e-a8b2-43ac-a527-81cd24179a04 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:32.598820 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7c962a3e-a8b2-43ac-a527-81cd24179a04 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:32.599264 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7c962a3e-a8b2-43ac-a527-81cd24179a04 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:32.724723 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-7c962a3e-a8b2-43ac-a527-81cd24179a04 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:32.733398 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7c962a3e-a8b2-43ac-a527-81cd24179a04 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.147415 May 23 15:34:32.733960 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 317/642] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:32 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:33.345489 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4e742ad0-6379-4914-9e49-fb4a18a4f4d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:33.346112 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4e742ad0-6379-4914-9e49-fb4a18a4f4d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:33.352730 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4e742ad0-6379-4914-9e49-fb4a18a4f4d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:33.353150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4e742ad0-6379-4914-9e49-fb4a18a4f4d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:33.353915 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4e742ad0-6379-4914-9e49-fb4a18a4f4d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:33.354353 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4e742ad0-6379-4914-9e49-fb4a18a4f4d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:33.480970 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4e742ad0-6379-4914-9e49-fb4a18a4f4d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:33.488948 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4e742ad0-6379-4914-9e49-fb4a18a4f4d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:33.490458 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4e742ad0-6379-4914-9e49-fb4a18a4f4d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:33.491564 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4e742ad0-6379-4914-9e49-fb4a18a4f4d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1407 microversion: 2.20 time: 0.150148 May 23 15:34:33.492127 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 326/643] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:34:33 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:34:33.549488 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-becc54e1-952d-435f-a792-833e778079b8 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:33.550095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-becc54e1-952d-435f-a792-833e778079b8 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:33.556454 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-becc54e1-952d-435f-a792-833e778079b8 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:33.556925 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-becc54e1-952d-435f-a792-833e778079b8 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:33.557681 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-becc54e1-952d-435f-a792-833e778079b8 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:33.558115 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-becc54e1-952d-435f-a792-833e778079b8 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:33.688260 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-becc54e1-952d-435f-a792-833e778079b8 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:33.695661 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-becc54e1-952d-435f-a792-833e778079b8 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1553 microversion: 2.1 time: 0.149996 May 23 15:34:33.696219 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 318/644] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:33 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:33.751473 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ec1a2e95-2f59-40da-9dc1-eb582cd5b5c8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:33.752095 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ec1a2e95-2f59-40da-9dc1-eb582cd5b5c8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:33.758062 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ec1a2e95-2f59-40da-9dc1-eb582cd5b5c8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:33.758517 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ec1a2e95-2f59-40da-9dc1-eb582cd5b5c8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:33.759286 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ec1a2e95-2f59-40da-9dc1-eb582cd5b5c8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:33.759727 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ec1a2e95-2f59-40da-9dc1-eb582cd5b5c8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:33.895561 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ec1a2e95-2f59-40da-9dc1-eb582cd5b5c8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:33.897330 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-766bbc4e-7991-40b2-8c54-50e09c45e34c req-d769fa09-6029-4189-ae1f-63affd42756d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5c3bd6-1b7d-4c25-a705-2291f6709285", "name": "network-vif-plugged", "status": "completed", "tag": "1163c3a8-18a2-4093-9e90-731d856e8076"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:33.904991 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ec1a2e95-2f59-40da-9dc1-eb582cd5b5c8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.158155 May 23 15:34:33.905916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 327/645] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:33 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:33.906780 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-766bbc4e-7991-40b2-8c54-50e09c45e34c req-d769fa09-6029-4189-ae1f-63affd42756d service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:33.907348 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-766bbc4e-7991-40b2-8c54-50e09c45e34c req-d769fa09-6029-4189-ae1f-63affd42756d service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:33.919270 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-766bbc4e-7991-40b2-8c54-50e09c45e34c req-d769fa09-6029-4189-ae1f-63affd42756d service nova] Creating event network-vif-plugged:1163c3a8-18a2-4093-9e90-731d856e8076 for instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 on hv-cinder-84112 May 23 15:34:33.925387 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-766bbc4e-7991-40b2-8c54-50e09c45e34c req-d769fa09-6029-4189-ae1f-63affd42756d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032014 May 23 15:34:33.925992 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 319/646] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:34:34.509897 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-91a03325-2a2a-4e58-a84c-68afa8a2cfb3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:34.510506 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-91a03325-2a2a-4e58-a84c-68afa8a2cfb3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:34.517973 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-91a03325-2a2a-4e58-a84c-68afa8a2cfb3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:34.518666 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-91a03325-2a2a-4e58-a84c-68afa8a2cfb3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:34.519455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-91a03325-2a2a-4e58-a84c-68afa8a2cfb3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:34.519903 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-91a03325-2a2a-4e58-a84c-68afa8a2cfb3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:34.713278 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-86efaaaa-ec8e-4298-ac30-dcb1732103cf tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:34.713986 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-86efaaaa-ec8e-4298-ac30-dcb1732103cf tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:34.721455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86efaaaa-ec8e-4298-ac30-dcb1732103cf tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:34.721916 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86efaaaa-ec8e-4298-ac30-dcb1732103cf tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:34.722691 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86efaaaa-ec8e-4298-ac30-dcb1732103cf tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:34.723136 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86efaaaa-ec8e-4298-ac30-dcb1732103cf tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:34.754772 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-91a03325-2a2a-4e58-a84c-68afa8a2cfb3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:34.764107 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-91a03325-2a2a-4e58-a84c-68afa8a2cfb3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:34.765780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-91a03325-2a2a-4e58-a84c-68afa8a2cfb3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:34.767012 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-91a03325-2a2a-4e58-a84c-68afa8a2cfb3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1407 microversion: 2.20 time: 0.261025 May 23 15:34:34.767661 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 328/647] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:34:34 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:34:34.784761 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:34.807250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=6 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:34.856965 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-86efaaaa-ec8e-4298-ac30-dcb1732103cf tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:34.864855 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-86efaaaa-ec8e-4298-ac30-dcb1732103cf tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1553 microversion: 2.1 time: 0.155889 May 23 15:34:34.865443 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 320/648] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:34 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:34:34.922577 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4c86dec0-084b-465b-9e09-8dc2933ca46e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:34.923211 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4c86dec0-084b-465b-9e09-8dc2933ca46e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:34.929272 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c86dec0-084b-465b-9e09-8dc2933ca46e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:34.929725 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c86dec0-084b-465b-9e09-8dc2933ca46e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:34.930536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c86dec0-084b-465b-9e09-8dc2933ca46e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:34.930938 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c86dec0-084b-465b-9e09-8dc2933ca46e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:34.931403 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=6 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:35.057263 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-30a70d79-f009-472d-a602-c0ec489bfa03 req-02a2c1ec-1d32-4746-bbd3-d3ecb7298773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55f39cba-5943-42d5-9322-58f3af0d39f8", "name": "network-vif-deleted", "tag": "d674721e-f3c3-41d6-99a3-5276229c8c17"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:35.066695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-30a70d79-f009-472d-a602-c0ec489bfa03 req-02a2c1ec-1d32-4746-bbd3-d3ecb7298773 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:35.067144 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-30a70d79-f009-472d-a602-c0ec489bfa03 req-02a2c1ec-1d32-4746-bbd3-d3ecb7298773 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:35.079196 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-30a70d79-f009-472d-a602-c0ec489bfa03 req-02a2c1ec-1d32-4746-bbd3-d3ecb7298773 service nova] Creating event network-vif-deleted:d674721e-f3c3-41d6-99a3-5276229c8c17 for instance 55f39cba-5943-42d5-9322-58f3af0d39f8 on hv-cinder-84112 May 23 15:34:35.084271 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-30a70d79-f009-472d-a602-c0ec489bfa03 req-02a2c1ec-1d32-4746-bbd3-d3ecb7298773 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031075 May 23 15:34:35.084897 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 321/649] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:34:35.113621 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4c86dec0-084b-465b-9e09-8dc2933ca46e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:35.121572 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4c86dec0-084b-465b-9e09-8dc2933ca46e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.203289 May 23 15:34:35.122139 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 329/650] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:34 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:35.786430 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-19bce4b2-078c-458f-8283-b25459b41d67 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:35.787266 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-19bce4b2-078c-458f-8283-b25459b41d67 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:35.793985 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-19bce4b2-078c-458f-8283-b25459b41d67 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:35.794415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-19bce4b2-078c-458f-8283-b25459b41d67 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:35.795820 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-19bce4b2-078c-458f-8283-b25459b41d67 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:35.796259 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-19bce4b2-078c-458f-8283-b25459b41d67 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:35.881556 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-61e2fbf8-851f-456c-86f4-060bad78e0a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:35.882254 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-61e2fbf8-851f-456c-86f4-060bad78e0a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:35.889668 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-61e2fbf8-851f-456c-86f4-060bad78e0a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:35.890223 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-61e2fbf8-851f-456c-86f4-060bad78e0a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:35.891097 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-61e2fbf8-851f-456c-86f4-060bad78e0a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:35.891600 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-61e2fbf8-851f-456c-86f4-060bad78e0a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:35.922977 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-61e2fbf8-851f-456c-86f4-060bad78e0a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:35.923424 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-61e2fbf8-851f-456c-86f4-060bad78e0a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:35.923881 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-61e2fbf8-851f-456c-86f4-060bad78e0a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lazy-loading 'fault' on Instance uuid 55f39cba-5943-42d5-9322-58f3af0d39f8 {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:34:35.927367 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-19bce4b2-078c-458f-8283-b25459b41d67 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:35.935640 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-19bce4b2-078c-458f-8283-b25459b41d67 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:35.937389 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-19bce4b2-078c-458f-8283-b25459b41d67 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:35.938593 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-19bce4b2-078c-458f-8283-b25459b41d67 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1407 microversion: 2.20 time: 0.156493 May 23 15:34:35.939277 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 322/651] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:34:35 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:34:35.967446 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-61e2fbf8-851f-456c-86f4-060bad78e0a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed468da0c844b688f5f91768b0dd96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591802cf5c044932940307866f388790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:35.974805 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-61e2fbf8-851f-456c-86f4-060bad78e0a2 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 200 len: 1348 microversion: 2.1 time: 0.097265 May 23 15:34:35.975359 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 330/652] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:35 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:34:36.139704 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1b67fdcb-5004-4736-b648-170d4c59813f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:36.140280 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-1b67fdcb-5004-4736-b648-170d4c59813f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:36.146663 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1b67fdcb-5004-4736-b648-170d4c59813f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:36.147135 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1b67fdcb-5004-4736-b648-170d4c59813f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:36.147882 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1b67fdcb-5004-4736-b648-170d4c59813f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:36.148325 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1b67fdcb-5004-4736-b648-170d4c59813f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:36.281229 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-1b67fdcb-5004-4736-b648-170d4c59813f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:36.289226 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1b67fdcb-5004-4736-b648-170d4c59813f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.153759 May 23 15:34:36.289794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 323/653] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:36 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:36.956274 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-fdbdd23c-9681-44a5-874e-2e5534309317 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:36.956930 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-fdbdd23c-9681-44a5-874e-2e5534309317 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:36.963967 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fdbdd23c-9681-44a5-874e-2e5534309317 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:36.964519 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fdbdd23c-9681-44a5-874e-2e5534309317 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:36.965343 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fdbdd23c-9681-44a5-874e-2e5534309317 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:36.965882 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fdbdd23c-9681-44a5-874e-2e5534309317 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:36.991394 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1d31b157-645e-422a-9c11-814975e02f35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:36.992158 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-1d31b157-645e-422a-9c11-814975e02f35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] [instance: 55f39cba-5943-42d5-9322-58f3af0d39f8] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:36.999760 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1d31b157-645e-422a-9c11-814975e02f35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:37.000219 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1d31b157-645e-422a-9c11-814975e02f35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:37.001027 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1d31b157-645e-422a-9c11-814975e02f35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:37.001464 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1d31b157-645e-422a-9c11-814975e02f35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:37.016098 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-1d31b157-645e-422a-9c11-814975e02f35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] HTTP exception thrown: Instance 55f39cba-5943-42d5-9322-58f3af0d39f8 could not be found. May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1d31b157-645e-422a-9c11-814975e02f35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Request method failure captured: May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 HTTP/1.1 May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6jOWth3ODDWEW3YTsJiAXEH3WeFBczpGQyVNe9ft91Sig6d3LbY3avsiXSKlkieqDApEvSck2UjwzLOQYx4ZDbkK7CoSKN0xbD2xIqPV70-ojEvuOgM5xj5IWFQ5dZzASwEN4qyqBYAHx2a3CwtnvlyAQzsy3sV-W9mBo0zNykj7_M May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: 591802cf5c044932940307866f388790 May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-TestMinimumBasicScenario-582055684 May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:34:37.017793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:34:37.019449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/591802cf5c044932940307866f388790"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/591802cf5c044932940307866f388790"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/591802cf5c044932940307866f388790"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_591802cf5c044932940307866f388790", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:34:37.019449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-TestMinimumBasicScenario-582055684 May 23 15:34:37.019449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: 591802cf5c044932940307866f388790 May 23 15:34:37.019449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-TestMinimumBasicScenario-582055684 May 23 15:34:37.019449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-TestMinimumBasicScenario-582055684-project May 23 15:34:37.019449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:34:37.019449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:34:37.019449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: ceed468da0c844b688f5f91768b0dd96 May 23 15:34:37.019449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-TestMinimumBasicScenario-582055684-project May 23 15:34:37.019449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:34:37.019449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance 55f39cba-5943-42d5-9322-58f3af0d39f8 could not be found. May 23 15:34:37.019449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': '55f39cba-5943-42d5-9322-58f3af0d39f8'} May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55f39cba-5943-42d5-9322-58f3af0d39f8 could not be found. May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:34:37.020195 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f39cba-5943-42d5-9322-58f3af0d39f8 could not be found. May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f39cba-5943-42d5-9322-58f3af0d39f8 could not be found. May 23 15:34:37.021693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:37.023095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1d31b157-645e-422a-9c11-814975e02f35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Returning 404 to user: Instance 55f39cba-5943-42d5-9322-58f3af0d39f8 could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:34:37.023095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1d31b157-645e-422a-9c11-814975e02f35 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8" status: 404 len: 111 microversion: 2.1 time: 0.031868 May 23 15:34:37.023095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 324/654] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:36 2022] GET /compute/v2.1/servers/55f39cba-5943-42d5-9322-58f3af0d39f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:34:37.027577 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-808bea8e-4c13-43cf-8c52-d13000765ae7 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] Calling method '.version_select at 0x7f0d7b851e50>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:37.046711 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-808bea8e-4c13-43cf-8c52-d13000765ae7 tempest-TestMinimumBasicScenario-582055684 tempest-TestMinimumBasicScenario-582055684-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-984145697" status: 202 len: 0 microversion: 2.1 time: 0.022526 May 23 15:34:37.047286 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 325/655] 10.222.0.30 () {58 vars in 1268 bytes} [Mon May 23 15:34:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-984145697 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:34:37.109762 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-fdbdd23c-9681-44a5-874e-2e5534309317 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:37.118202 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-fdbdd23c-9681-44a5-874e-2e5534309317 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:37.119715 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-fdbdd23c-9681-44a5-874e-2e5534309317 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:37.120905 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-fdbdd23c-9681-44a5-874e-2e5534309317 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1599 microversion: 2.20 time: 0.168722 May 23 15:34:37.121615 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 331/656] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:34:36 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:34:37.138867 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-eb84fa93-f78e-4bb8-a4fa-95b7a4c1cc41 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:37.139450 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-eb84fa93-f78e-4bb8-a4fa-95b7a4c1cc41 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:37.146416 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-eb84fa93-f78e-4bb8-a4fa-95b7a4c1cc41 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:37.147080 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-eb84fa93-f78e-4bb8-a4fa-95b7a4c1cc41 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:37.147858 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-eb84fa93-f78e-4bb8-a4fa-95b7a4c1cc41 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:37.148307 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-eb84fa93-f78e-4bb8-a4fa-95b7a4c1cc41 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:37.230670 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-eb84fa93-f78e-4bb8-a4fa-95b7a4c1cc41 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095769 May 23 15:34:37.231258 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 326/657] 10.222.0.30 () {60 vars in 1315 bytes} [Mon May 23 15:34:37 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:34:37.307167 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-39ff4087-b40d-47ae-abd5-01889e271937 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:37.307868 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-39ff4087-b40d-47ae-abd5-01889e271937 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:37.314208 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-39ff4087-b40d-47ae-abd5-01889e271937 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:37.314654 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-39ff4087-b40d-47ae-abd5-01889e271937 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:37.315634 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-39ff4087-b40d-47ae-abd5-01889e271937 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:37.316070 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-39ff4087-b40d-47ae-abd5-01889e271937 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:37.458059 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-39ff4087-b40d-47ae-abd5-01889e271937 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:37.466111 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-39ff4087-b40d-47ae-abd5-01889e271937 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.162863 May 23 15:34:37.466840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 332/658] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:37 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:38.434930 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-cc411aea-d99e-4f0e-b42a-8069094ef80c req-eab7516a-3565-44b8-b6c2-fb7000099acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5c3bd6-1b7d-4c25-a705-2291f6709285", "tag": "1163c3a8-18a2-4093-9e90-731d856e8076"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:38.444423 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-cc411aea-d99e-4f0e-b42a-8069094ef80c req-eab7516a-3565-44b8-b6c2-fb7000099acb service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:38.444895 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-cc411aea-d99e-4f0e-b42a-8069094ef80c req-eab7516a-3565-44b8-b6c2-fb7000099acb service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:38.457711 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-cc411aea-d99e-4f0e-b42a-8069094ef80c req-eab7516a-3565-44b8-b6c2-fb7000099acb service nova] Creating event network-changed:1163c3a8-18a2-4093-9e90-731d856e8076 for instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 on hv-cinder-84112 May 23 15:34:38.463476 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-cc411aea-d99e-4f0e-b42a-8069094ef80c req-eab7516a-3565-44b8-b6c2-fb7000099acb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032089 May 23 15:34:38.465101 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 327/659] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:38.485097 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-267c8daf-269a-4e67-bc2a-97e66547d37e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:38.485720 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-267c8daf-269a-4e67-bc2a-97e66547d37e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:38.492686 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-267c8daf-269a-4e67-bc2a-97e66547d37e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:38.493179 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-267c8daf-269a-4e67-bc2a-97e66547d37e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:38.493953 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-267c8daf-269a-4e67-bc2a-97e66547d37e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:38.494387 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-267c8daf-269a-4e67-bc2a-97e66547d37e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:38.689120 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-267c8daf-269a-4e67-bc2a-97e66547d37e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:38.697154 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-267c8daf-269a-4e67-bc2a-97e66547d37e tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.217390 May 23 15:34:38.697944 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 333/660] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:38 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:39.715524 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-2b28149a-81b3-4b5d-a4fc-8dc73dffdd48 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:39.717574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-2b28149a-81b3-4b5d-a4fc-8dc73dffdd48 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:39.724486 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2b28149a-81b3-4b5d-a4fc-8dc73dffdd48 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:39.725237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2b28149a-81b3-4b5d-a4fc-8dc73dffdd48 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:39.726174 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2b28149a-81b3-4b5d-a4fc-8dc73dffdd48 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:39.726767 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2b28149a-81b3-4b5d-a4fc-8dc73dffdd48 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:39.871130 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-2b28149a-81b3-4b5d-a4fc-8dc73dffdd48 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:39.879778 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-2b28149a-81b3-4b5d-a4fc-8dc73dffdd48 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1735 microversion: 2.1 time: 0.169114 May 23 15:34:39.880649 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 328/661] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:39 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:40.898244 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-78559aa9-3a1b-4b95-b37e-99bc4247f602 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:40.898861 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-78559aa9-3a1b-4b95-b37e-99bc4247f602 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:40.901254 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:40.914033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-78559aa9-3a1b-4b95-b37e-99bc4247f602 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:40.914033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-78559aa9-3a1b-4b95-b37e-99bc4247f602 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:40.914454 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-78559aa9-3a1b-4b95-b37e-99bc4247f602 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:40.916263 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-78559aa9-3a1b-4b95-b37e-99bc4247f602 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:41.161893 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-78559aa9-3a1b-4b95-b37e-99bc4247f602 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:41.173452 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-78559aa9-3a1b-4b95-b37e-99bc4247f602 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1715 microversion: 2.1 time: 0.278904 May 23 15:34:41.174538 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 334/662] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:40 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1715 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:34:41.304924 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-80558b2f-f584-4059-aa13-916216e7698a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:41.306098 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-80558b2f-f584-4059-aa13-916216e7698a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:41.313234 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-80558b2f-f584-4059-aa13-916216e7698a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:41.313772 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-80558b2f-f584-4059-aa13-916216e7698a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:41.314620 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-80558b2f-f584-4059-aa13-916216e7698a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:41.315141 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-80558b2f-f584-4059-aa13-916216e7698a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:41.434038 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-80558b2f-f584-4059-aa13-916216e7698a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] HTTP exception thrown: Cannot 'detach_volume' instance bb26539d-bd10-48dd-9c5d-433060babfb6 while it is in vm_state rescued May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-80558b2f-f584-4059-aa13-916216e7698a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Request method failure captured: May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: DELETE /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/os-volume_attachments/393eef02-5358-419b-bd2d-0dcf6259445e HTTP/1.1 May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6h-A5hbnr5tRX4j7z_Fo2SkNdX-EO3Ww9aps-yabims8fjFdE2KLn43LVxISco1aI6PJe4GKJ_4L1myusbRV8rLv7u1bxIgWrbgq5gXl0OhYXPQF8QPoudR53EbpJbeSIsHyVZJNXRpJlD2FdoebyscshU-JjudZe-a7dzSa1AlnJ8 May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: 0712b807a4584f7b8f019ceb65ff1e14 May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1966403117 May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:34:41.435977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:34:41.437362 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0712b807a4584f7b8f019ceb65ff1e14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0712b807a4584f7b8f019ceb65ff1e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0712b807a4584f7b8f019ceb65ff1e14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0712b807a4584f7b8f019ceb65ff1e14", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:34:41.437362 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1966403117 May 23 15:34:41.437362 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: 0712b807a4584f7b8f019ceb65ff1e14 May 23 15:34:41.437362 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1966403117 May 23 15:34:41.437362 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-ServerRescueNegativeTestJSON-1966403117-project May 23 15:34:41.437362 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:34:41.437362 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:34:41.437362 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: 5074b9fa045543b9a62bf751e736d0df May 23 15:34:41.437362 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1966403117-project May 23 15:34:41.437362 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:34:41.437362 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Cannot 'detach_volume' instance bb26539d-bd10-48dd-9c5d-433060babfb6 while it is in vm_state rescued May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'server_id': 'bb26539d-bd10-48dd-9c5d-433060babfb6', 'id': '393eef02-5358-419b-bd2d-0dcf6259445e'} May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bb26539d-bd10-48dd-9c5d-433060babfb6 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:34:41.438037 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:41.439798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 23 15:34:41.439798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 15:34:41.439798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 15:34:41.439798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 15:34:41.439798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance bb26539d-bd10-48dd-9c5d-433060babfb6 while it is in vm_state rescued May 23 15:34:41.439798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:41.439798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:41.439798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:41.439798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:41.439798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:41.439798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:41.439798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:34:41.439798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:34:41.439798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance bb26539d-bd10-48dd-9c5d-433060babfb6 while it is in vm_state rescued May 23 15:34:41.439798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:41.439798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-80558b2f-f584-4059-aa13-916216e7698a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Returning 409 to user: Cannot 'detach_volume' instance bb26539d-bd10-48dd-9c5d-433060babfb6 while it is in vm_state rescued {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:34:41.440766 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-80558b2f-f584-4059-aa13-916216e7698a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/os-volume_attachments/393eef02-5358-419b-bd2d-0dcf6259445e" status: 409 len: 152 microversion: 2.1 time: 0.136858 May 23 15:34:41.440766 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 329/663] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 15:34:41 2022] DELETE /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/os-volume_attachments/393eef02-5358-419b-bd2d-0dcf6259445e => generated 152 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 15:34:41.447762 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f5b05a03-aeed-4af9-89bc-ba6628fc14bc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:41.448496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f5b05a03-aeed-4af9-89bc-ba6628fc14bc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:41.456243 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f5b05a03-aeed-4af9-89bc-ba6628fc14bc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:41.456957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f5b05a03-aeed-4af9-89bc-ba6628fc14bc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:41.457855 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f5b05a03-aeed-4af9-89bc-ba6628fc14bc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:41.458402 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f5b05a03-aeed-4af9-89bc-ba6628fc14bc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:41.695732 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f5b05a03-aeed-4af9-89bc-ba6628fc14bc tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "POST /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/action" status: 202 len: 0 microversion: 2.1 time: 0.252446 May 23 15:34:41.699326 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 335/664] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 15:34:41 2022] POST /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:34:41.713673 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-0f9d5fcb-b4ab-49ad-ae17-b3eed3d2169c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:41.714329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-0f9d5fcb-b4ab-49ad-ae17-b3eed3d2169c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:41.721618 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0f9d5fcb-b4ab-49ad-ae17-b3eed3d2169c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:41.722068 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0f9d5fcb-b4ab-49ad-ae17-b3eed3d2169c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:41.722864 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0f9d5fcb-b4ab-49ad-ae17-b3eed3d2169c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:41.723298 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0f9d5fcb-b4ab-49ad-ae17-b3eed3d2169c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:41.864542 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-0f9d5fcb-b4ab-49ad-ae17-b3eed3d2169c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:41.872798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-0f9d5fcb-b4ab-49ad-ae17-b3eed3d2169c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1723 microversion: 2.1 time: 0.163458 May 23 15:34:41.873693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 330/665] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:41 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:42.892240 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5045080f-06aa-4430-9bcd-c11a451f8786 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:42.893449 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-5045080f-06aa-4430-9bcd-c11a451f8786 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:42.899700 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5045080f-06aa-4430-9bcd-c11a451f8786 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:42.900158 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5045080f-06aa-4430-9bcd-c11a451f8786 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:42.900963 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5045080f-06aa-4430-9bcd-c11a451f8786 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:42.901531 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5045080f-06aa-4430-9bcd-c11a451f8786 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:43.082661 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-5045080f-06aa-4430-9bcd-c11a451f8786 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:43.090608 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5045080f-06aa-4430-9bcd-c11a451f8786 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1723 microversion: 2.1 time: 0.203862 May 23 15:34:43.091167 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 336/666] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:42 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:34:44.110293 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-38daac8c-fab8-4e5e-95c1-471539502deb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:44.110891 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-38daac8c-fab8-4e5e-95c1-471539502deb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:44.117848 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-38daac8c-fab8-4e5e-95c1-471539502deb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:44.118303 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-38daac8c-fab8-4e5e-95c1-471539502deb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:44.119085 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-38daac8c-fab8-4e5e-95c1-471539502deb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:44.119521 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-38daac8c-fab8-4e5e-95c1-471539502deb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:44.282937 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-38daac8c-fab8-4e5e-95c1-471539502deb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:44.291424 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-38daac8c-fab8-4e5e-95c1-471539502deb tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1723 microversion: 2.1 time: 0.185681 May 23 15:34:44.292203 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 331/667] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:44 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:45.309588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4cf25727-309a-4f9d-b61e-95034eb95528 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:45.310329 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4cf25727-309a-4f9d-b61e-95034eb95528 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:45.316975 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4cf25727-309a-4f9d-b61e-95034eb95528 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:45.317489 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4cf25727-309a-4f9d-b61e-95034eb95528 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:45.318316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4cf25727-309a-4f9d-b61e-95034eb95528 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:45.318816 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4cf25727-309a-4f9d-b61e-95034eb95528 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:45.572458 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4cf25727-309a-4f9d-b61e-95034eb95528 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:45.581275 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4cf25727-309a-4f9d-b61e-95034eb95528 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1729 microversion: 2.1 time: 0.274971 May 23 15:34:45.593512 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 337/668] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:45 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1729 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:45.599994 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1fccf4c8-4461-4448-a27b-b7d2c1a19963 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:45.600712 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-1fccf4c8-4461-4448-a27b-b7d2c1a19963 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:45.608356 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1fccf4c8-4461-4448-a27b-b7d2c1a19963 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:45.608819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1fccf4c8-4461-4448-a27b-b7d2c1a19963 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:45.609630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1fccf4c8-4461-4448-a27b-b7d2c1a19963 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:45.610072 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1fccf4c8-4461-4448-a27b-b7d2c1a19963 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:45.697007 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1fccf4c8-4461-4448-a27b-b7d2c1a19963 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100923 May 23 15:34:45.697593 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 332/669] 10.222.0.30 () {58 vars in 1274 bytes} [Mon May 23 15:34:45 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:46.746402 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-a9a33935-aa49-4e5a-b09b-fc945534b8d3 req-bf3710db-37b8-40f2-9c8f-e074d6cf57fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb26539d-bd10-48dd-9c5d-433060babfb6", "tag": "e105091f-4632-47d3-b731-412205a70375"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:46.756132 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-a9a33935-aa49-4e5a-b09b-fc945534b8d3 req-bf3710db-37b8-40f2-9c8f-e074d6cf57fe service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:46.756720 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-a9a33935-aa49-4e5a-b09b-fc945534b8d3 req-bf3710db-37b8-40f2-9c8f-e074d6cf57fe service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:46.770691 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-a9a33935-aa49-4e5a-b09b-fc945534b8d3 req-bf3710db-37b8-40f2-9c8f-e074d6cf57fe service nova] Creating event network-changed:e105091f-4632-47d3-b731-412205a70375 for instance bb26539d-bd10-48dd-9c5d-433060babfb6 on hv-cinder-84112 May 23 15:34:46.776434 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-a9a33935-aa49-4e5a-b09b-fc945534b8d3 req-bf3710db-37b8-40f2-9c8f-e074d6cf57fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036534 May 23 15:34:46.777827 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 338/670] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:46.930302 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-670d0c5c-8631-44ae-b45d-4104e63eb5d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:46.932145 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-670d0c5c-8631-44ae-b45d-4104e63eb5d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:46.943726 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-670d0c5c-8631-44ae-b45d-4104e63eb5d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:46.944476 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-670d0c5c-8631-44ae-b45d-4104e63eb5d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:46.945504 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-670d0c5c-8631-44ae-b45d-4104e63eb5d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:46.946100 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-670d0c5c-8631-44ae-b45d-4104e63eb5d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:46.976133 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:46.982097 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-670d0c5c-8631-44ae-b45d-4104e63eb5d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057114 May 23 15:34:46.983120 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 333/671] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:34:46 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:34:47.051871 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a0654e73-3971-4ceb-be53-68f3dd07dd17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:47.052464 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a0654e73-3971-4ceb-be53-68f3dd07dd17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:47.058698 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a0654e73-3971-4ceb-be53-68f3dd07dd17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:47.059343 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a0654e73-3971-4ceb-be53-68f3dd07dd17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:47.060301 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a0654e73-3971-4ceb-be53-68f3dd07dd17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:47.061259 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a0654e73-3971-4ceb-be53-68f3dd07dd17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:47.087539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a0654e73-3971-4ceb-be53-68f3dd07dd17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Going to try to terminate instance {{(pid=117974) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:34:47.121192 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:47.170780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a0654e73-3971-4ceb-be53-68f3dd07dd17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 204 len: 0 microversion: 2.1 time: 0.122748 May 23 15:34:47.174472 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 339/672] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:34:47 2022] DELETE /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:34:47.180163 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b8df2407-bcc7-45a0-8f8c-0bdf226663d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:47.181057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b8df2407-bcc7-45a0-8f8c-0bdf226663d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:47.190583 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b8df2407-bcc7-45a0-8f8c-0bdf226663d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:47.192768 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b8df2407-bcc7-45a0-8f8c-0bdf226663d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:47.193783 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b8df2407-bcc7-45a0-8f8c-0bdf226663d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:47.194379 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b8df2407-bcc7-45a0-8f8c-0bdf226663d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:47.545547 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b8df2407-bcc7-45a0-8f8c-0bdf226663d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:47.553369 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b8df2407-bcc7-45a0-8f8c-0bdf226663d0 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1671 microversion: 2.1 time: 0.377322 May 23 15:34:47.553936 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 334/673] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:47 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1671 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:48.571405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a34615ff-e083-449e-8d62-f946a993813b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:48.572117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a34615ff-e083-449e-8d62-f946a993813b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:48.579266 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a34615ff-e083-449e-8d62-f946a993813b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:48.579775 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a34615ff-e083-449e-8d62-f946a993813b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:48.580580 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a34615ff-e083-449e-8d62-f946a993813b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:48.581076 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a34615ff-e083-449e-8d62-f946a993813b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:48.765471 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a34615ff-e083-449e-8d62-f946a993813b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:48.773186 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a34615ff-e083-449e-8d62-f946a993813b tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1671 microversion: 2.1 time: 0.206148 May 23 15:34:48.773757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 340/674] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:48 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1671 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:48.790972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-bf4077d5-b1cc-4d3a-b0fe-3cea83faf75b req-9001bf09-9560-45da-8403-4cc52562ec83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb26539d-bd10-48dd-9c5d-433060babfb6", "tag": "e105091f-4632-47d3-b731-412205a70375"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:48.799957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-bf4077d5-b1cc-4d3a-b0fe-3cea83faf75b req-9001bf09-9560-45da-8403-4cc52562ec83 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:48.800396 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-bf4077d5-b1cc-4d3a-b0fe-3cea83faf75b req-9001bf09-9560-45da-8403-4cc52562ec83 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:48.811580 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-bf4077d5-b1cc-4d3a-b0fe-3cea83faf75b req-9001bf09-9560-45da-8403-4cc52562ec83 service nova] Creating event network-changed:e105091f-4632-47d3-b731-412205a70375 for instance bb26539d-bd10-48dd-9c5d-433060babfb6 on hv-cinder-84112 May 23 15:34:48.816396 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-bf4077d5-b1cc-4d3a-b0fe-3cea83faf75b req-9001bf09-9560-45da-8403-4cc52562ec83 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029138 May 23 15:34:48.816972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 335/675] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:49.790408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-9d190976-a8f1-4050-b647-1abe2e2d8a39 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:49.791181 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-9d190976-a8f1-4050-b647-1abe2e2d8a39 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:49.798044 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9d190976-a8f1-4050-b647-1abe2e2d8a39 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:49.798768 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9d190976-a8f1-4050-b647-1abe2e2d8a39 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:49.799672 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9d190976-a8f1-4050-b647-1abe2e2d8a39 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:49.800317 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9d190976-a8f1-4050-b647-1abe2e2d8a39 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:50.049790 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9d190976-a8f1-4050-b647-1abe2e2d8a39 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:50.058215 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-9d190976-a8f1-4050-b647-1abe2e2d8a39 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1671 microversion: 2.1 time: 0.271809 May 23 15:34:50.059010 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 341/676] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:49 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1671 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:50.558477 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-d7c3bbb0-7d8a-4e7b-a256-84930adb0194 req-ed6cd960-f110-41df-a30c-3e1f2a9db8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1c71d3-9470-4f72-a76c-e6c114bd4821", "name": "network-vif-deleted", "tag": "9beaf3ec-d7f6-4009-b3ff-01ff1bc11a9e"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:50.567194 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-d7c3bbb0-7d8a-4e7b-a256-84930adb0194 req-ed6cd960-f110-41df-a30c-3e1f2a9db8d7 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:50.567786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-d7c3bbb0-7d8a-4e7b-a256-84930adb0194 req-ed6cd960-f110-41df-a30c-3e1f2a9db8d7 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:50.578788 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-d7c3bbb0-7d8a-4e7b-a256-84930adb0194 req-ed6cd960-f110-41df-a30c-3e1f2a9db8d7 service nova] Creating event network-vif-deleted:9beaf3ec-d7f6-4009-b3ff-01ff1bc11a9e for instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 on hv-cinder-84112 May 23 15:34:50.585435 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-d7c3bbb0-7d8a-4e7b-a256-84930adb0194 req-ed6cd960-f110-41df-a30c-3e1f2a9db8d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030833 May 23 15:34:50.586293 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 336/677] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:51.075594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-eee4e8f8-2752-4475-9773-f5945c654b38 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:51.076263 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-eee4e8f8-2752-4475-9773-f5945c654b38 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:51.082717 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eee4e8f8-2752-4475-9773-f5945c654b38 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:51.083167 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eee4e8f8-2752-4475-9773-f5945c654b38 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:51.083935 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eee4e8f8-2752-4475-9773-f5945c654b38 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:51.084373 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eee4e8f8-2752-4475-9773-f5945c654b38 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:51.116264 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eee4e8f8-2752-4475-9773-f5945c654b38 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:51.116715 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eee4e8f8-2752-4475-9773-f5945c654b38 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:51.117257 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-eee4e8f8-2752-4475-9773-f5945c654b38 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lazy-loading 'fault' on Instance uuid 9e1c71d3-9470-4f72-a76c-e6c114bd4821 {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:34:51.166094 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-eee4e8f8-2752-4475-9773-f5945c654b38 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:51.174590 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-eee4e8f8-2752-4475-9773-f5945c654b38 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 200 len: 1326 microversion: 2.1 time: 0.102841 May 23 15:34:51.175300 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 342/678] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:51 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 1326 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:52.193544 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-cb64fb83-6fb1-4359-8a5b-11f0307efc23 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:52.194245 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-cb64fb83-6fb1-4359-8a5b-11f0307efc23 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:52.200397 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cb64fb83-6fb1-4359-8a5b-11f0307efc23 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:52.200843 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cb64fb83-6fb1-4359-8a5b-11f0307efc23 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:52.202335 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cb64fb83-6fb1-4359-8a5b-11f0307efc23 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:52.202769 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cb64fb83-6fb1-4359-8a5b-11f0307efc23 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:52.215591 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-cb64fb83-6fb1-4359-8a5b-11f0307efc23 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] HTTP exception thrown: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-cb64fb83-6fb1-4359-8a5b-11f0307efc23 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Request method failure captured: May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 HTTP/1.1 May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6iFP0TGBa2hDfXSS6FqwwJRnPWaLet6Ntjd-Lq3B8RNMryejuq1rkw52mSjm1q_At_4C3FIqdmchkYRj-zSXrOvsMvOqmww91oAYQtQtJzMAmqnUHFP8L3FFt1Uor15UonjhBOFMTpLJodG6S0rbyouSgz4C7jNygN7x2Yx3x-IS2s May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: 9aaff9db173d4618929536b08d2be8f0 May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-AttachVolumeTestJSON-1837964167 May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:34:52.217227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:34:52.218810 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9aaff9db173d4618929536b08d2be8f0", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:34:52.218810 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-AttachVolumeTestJSON-1837964167 May 23 15:34:52.218810 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: 9aaff9db173d4618929536b08d2be8f0 May 23 15:34:52.218810 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1837964167 May 23 15:34:52.218810 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-AttachVolumeTestJSON-1837964167-project May 23 15:34:52.218810 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:34:52.218810 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:34:52.218810 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: d0ae34a029c14c6f826456414ac0670d May 23 15:34:52.218810 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-AttachVolumeTestJSON-1837964167-project May 23 15:34:52.218810 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:34:52.218810 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. May 23 15:34:52.218810 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': '9e1c71d3-9470-4f72-a76c-e6c114bd4821'} May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:34:52.219740 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. May 23 15:34:52.221241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:34:52.222628 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-cb64fb83-6fb1-4359-8a5b-11f0307efc23 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Returning 404 to user: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:34:52.222628 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-cb64fb83-6fb1-4359-8a5b-11f0307efc23 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 404 len: 111 microversion: 2.1 time: 0.029905 May 23 15:34:52.222628 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 337/679] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:52 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:34:52.227835 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-42316a08-7b8e-403a-ac95-e1a3790a6546 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '.version_select at 0x7f0d7a36d940>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:52.244963 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-42316a08-7b8e-403a-ac95-e1a3790a6546 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-215606660" status: 202 len: 0 microversion: 2.1 time: 0.020828 May 23 15:34:52.245519 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 343/680] 10.222.0.30 () {58 vars in 1217 bytes} [Mon May 23 15:34:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-215606660 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:34:53.097213 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-59f48cda-295a-4e77-97ea-96c64e5666b1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Action: 'create', calling method: .version_select at 0x7f0d7a26ea60>, body: {"keypair": {"name": "tempest-keypair-1425277546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPenBL4DpW6KjStXQv666WlJ+fvAO56HDK4r8qh61mpWH2SA5IxPf4bUvnwB9HOhYmnfT00yEsO0G7Wq/CB/9hjbaQnKQPvINUklB4UfdzCb3zLl0yGwe2wA6JvHWT5zSg=="}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:53.114092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-59f48cda-295a-4e77-97ea-96c64e5666b1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Getting quotas for project 9aaff9db173d4618929536b08d2be8f0. Resources: {'key_pairs'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:34:53.117776 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-59f48cda-295a-4e77-97ea-96c64e5666b1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Getting quotas for user d0ae34a029c14c6f826456414ac0670d and project 9aaff9db173d4618929536b08d2be8f0. Resources: {'key_pairs'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:34:53.139034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-59f48cda-295a-4e77-97ea-96c64e5666b1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047400 May 23 15:34:53.139611 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 338/681] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 15:34:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:54.649407 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3e7cc802-9066-4a86-b15d-cf10f78721de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1621458723", "imageRef": "807d39e3-2293-48ca-b2cd-675f7c931014", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a072baa-6965-4350-b247-fb58bbcac26a"}], "security_groups": [{"name": "tempest-securitygroup--801871903"}], "key_name": "tempest-keypair-1425277546", "user_data": "}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:54.750022 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.network.neutron [None req-3e7cc802-9066-4a86-b15d-cf10f78721de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] validate_networks() for [('2a072baa-6965-4350-b247-fb58bbcac26a', None, None, None, None, None)] {{(pid=117974) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:34:55.155161 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-3e7cc802-9066-4a86-b15d-cf10f78721de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Flavor limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:34:55.155597 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-3e7cc802-9066-4a86-b15d-cf10f78721de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Image limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:34:55.156083 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-3e7cc802-9066-4a86-b15d-cf10f78721de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Flavor pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:34:55.156501 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-3e7cc802-9066-4a86-b15d-cf10f78721de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Image pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:34:55.156989 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-3e7cc802-9066-4a86-b15d-cf10f78721de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:34:55.165933 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3e7cc802-9066-4a86-b15d-cf10f78721de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:55.166392 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3e7cc802-9066-4a86-b15d-cf10f78721de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:55.167201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3e7cc802-9066-4a86-b15d-cf10f78721de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:55.167642 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3e7cc802-9066-4a86-b15d-cf10f78721de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:55.185275 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-3e7cc802-9066-4a86-b15d-cf10f78721de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Getting quotas for project 9aaff9db173d4618929536b08d2be8f0. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:34:55.189542 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-3e7cc802-9066-4a86-b15d-cf10f78721de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Getting quotas for user d0ae34a029c14c6f826456414ac0670d and project 9aaff9db173d4618929536b08d2be8f0. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:34:55.200383 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3e7cc802-9066-4a86-b15d-cf10f78721de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Going to run 1 instances... {{(pid=117974) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:34:55.202870 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3e7cc802-9066-4a86-b15d-cf10f78721de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='807d39e3-2293-48ca-b2cd-675f7c931014',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:34:55.249695 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3e7cc802-9066-4a86-b15d-cf10f78721de tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.604548 May 23 15:34:55.250339 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 344/682] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:34:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:34:55.261608 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-99e09fe2-8f9c-4469-9a4f-a08ca8320d08 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:55.262756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-99e09fe2-8f9c-4469-9a4f-a08ca8320d08 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:55.321371 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-99e09fe2-8f9c-4469-9a4f-a08ca8320d08 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:55.329321 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-99e09fe2-8f9c-4469-9a4f-a08ca8320d08 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1238 microversion: 2.1 time: 0.072222 May 23 15:34:55.329895 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 339/683] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:55 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:56.346275 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-7271a2f8-6cac-437f-a072-0c00c7997a50 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:56.347002 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-7271a2f8-6cac-437f-a072-0c00c7997a50 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:56.353447 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7271a2f8-6cac-437f-a072-0c00c7997a50 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:56.353933 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7271a2f8-6cac-437f-a072-0c00c7997a50 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:56.354704 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7271a2f8-6cac-437f-a072-0c00c7997a50 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:56.355517 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7271a2f8-6cac-437f-a072-0c00c7997a50 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:56.419354 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-7271a2f8-6cac-437f-a072-0c00c7997a50 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:56.427389 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-7271a2f8-6cac-437f-a072-0c00c7997a50 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1290 microversion: 2.1 time: 0.085523 May 23 15:34:56.428177 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 345/684] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:56 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:57.445595 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3c501f13-690e-42ab-9f0c-33418542383e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:57.446482 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-3c501f13-690e-42ab-9f0c-33418542383e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:57.449222 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:57.451820 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-253806eb-16db-4561-b014-f3aa2f231cd5 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:57.453250 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-253806eb-16db-4561-b014-f3aa2f231cd5 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:57.456139 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3c501f13-690e-42ab-9f0c-33418542383e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:57.456885 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3c501f13-690e-42ab-9f0c-33418542383e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:57.457907 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3c501f13-690e-42ab-9f0c-33418542383e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:57.458555 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3c501f13-690e-42ab-9f0c-33418542383e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:57.460663 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-253806eb-16db-4561-b014-f3aa2f231cd5 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:57.461187 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-253806eb-16db-4561-b014-f3aa2f231cd5 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:57.462279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-253806eb-16db-4561-b014-f3aa2f231cd5 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:57.462723 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-253806eb-16db-4561-b014-f3aa2f231cd5 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:57.487263 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-253806eb-16db-4561-b014-f3aa2f231cd5 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48/ips" status: 200 len: 148 microversion: 2.1 time: 0.040255 May 23 15:34:57.488160 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 346/685] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 15:34:57 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:57.608751 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3c501f13-690e-42ab-9f0c-33418542383e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:57.620126 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-3c501f13-690e-42ab-9f0c-33418542383e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1363 microversion: 2.1 time: 0.178829 May 23 15:34:57.620722 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 340/686] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:57 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:57.887945 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-9733ac77-5f49-4732-97e0-07fffb09db96 req-5c71906b-ab00-4b9e-89ad-fc657e2ab03e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b2fc89f-88e8-42b3-9006-35470a9f74fc", "tag": "7781bf30-5eb4-4474-84ee-26a19cdd971e"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:57.900300 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-9733ac77-5f49-4732-97e0-07fffb09db96 req-5c71906b-ab00-4b9e-89ad-fc657e2ab03e service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:57.901077 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-9733ac77-5f49-4732-97e0-07fffb09db96 req-5c71906b-ab00-4b9e-89ad-fc657e2ab03e service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:57.914225 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-9733ac77-5f49-4732-97e0-07fffb09db96 req-5c71906b-ab00-4b9e-89ad-fc657e2ab03e service nova] Creating event network-changed:7781bf30-5eb4-4474-84ee-26a19cdd971e for instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc on hv-cinder-84112 May 23 15:34:57.923565 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-9733ac77-5f49-4732-97e0-07fffb09db96 req-5c71906b-ab00-4b9e-89ad-fc657e2ab03e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039290 May 23 15:34:57.924983 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 347/687] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:58.638153 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-eb243985-60c9-4d5e-8fa6-96eb10c73338 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:58.638885 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-eb243985-60c9-4d5e-8fa6-96eb10c73338 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:58.646657 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-eb243985-60c9-4d5e-8fa6-96eb10c73338 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:58.647105 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-eb243985-60c9-4d5e-8fa6-96eb10c73338 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:58.647863 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-eb243985-60c9-4d5e-8fa6-96eb10c73338 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:58.648293 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-eb243985-60c9-4d5e-8fa6-96eb10c73338 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:58.775534 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-eb243985-60c9-4d5e-8fa6-96eb10c73338 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:58.783390 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-eb243985-60c9-4d5e-8fa6-96eb10c73338 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1363 microversion: 2.1 time: 0.149137 May 23 15:34:58.783952 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 341/688] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:58 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:34:58.888471 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-49c5dd25-5eaf-4614-b11d-4d89b527667c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84d5ef4d-044c-4705-af68-18427c7dae15"}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:58.889835 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-49c5dd25-5eaf-4614-b11d-4d89b527667c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:58.896347 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-49c5dd25-5eaf-4614-b11d-4d89b527667c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:58.896796 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-49c5dd25-5eaf-4614-b11d-4d89b527667c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:58.897606 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-49c5dd25-5eaf-4614-b11d-4d89b527667c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:58.898046 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-49c5dd25-5eaf-4614-b11d-4d89b527667c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:59.572005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-49c5dd25-5eaf-4614-b11d-4d89b527667c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "POST /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.688093 May 23 15:34:59.572613 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 348/689] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 15:34:58 2022] POST /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48/os-volume_attachments => generated 194 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:59.800250 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a810ed92-ea8d-4c86-85d3-d907fe2390f1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:59.801188 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-a810ed92-ea8d-4c86-85d3-d907fe2390f1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:34:59.807784 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a810ed92-ea8d-4c86-85d3-d907fe2390f1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:59.808366 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a810ed92-ea8d-4c86-85d3-d907fe2390f1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:59.809285 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a810ed92-ea8d-4c86-85d3-d907fe2390f1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:34:59.809798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a810ed92-ea8d-4c86-85d3-d907fe2390f1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:34:59.941547 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a810ed92-ea8d-4c86-85d3-d907fe2390f1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:34:59.948814 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a810ed92-ea8d-4c86-85d3-d907fe2390f1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1363 microversion: 2.1 time: 0.152602 May 23 15:34:59.949417 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 342/690] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:34:59 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:00.968742 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-09d00a31-6e0b-4ff6-973d-c5e914a67f77 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:00.969415 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-09d00a31-6e0b-4ff6-973d-c5e914a67f77 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:00.975835 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-09d00a31-6e0b-4ff6-973d-c5e914a67f77 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:00.976310 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-09d00a31-6e0b-4ff6-973d-c5e914a67f77 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:00.977173 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-09d00a31-6e0b-4ff6-973d-c5e914a67f77 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:00.977637 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-09d00a31-6e0b-4ff6-973d-c5e914a67f77 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:01.106856 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-09d00a31-6e0b-4ff6-973d-c5e914a67f77 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:01.114877 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-09d00a31-6e0b-4ff6-973d-c5e914a67f77 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1363 microversion: 2.1 time: 0.151165 May 23 15:35:01.115445 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 349/691] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:00 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:02.131477 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c73bb854-69f2-46d6-ac22-804fce55c06c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:02.132101 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c73bb854-69f2-46d6-ac22-804fce55c06c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:02.139115 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c73bb854-69f2-46d6-ac22-804fce55c06c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:02.139622 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c73bb854-69f2-46d6-ac22-804fce55c06c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:02.140384 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c73bb854-69f2-46d6-ac22-804fce55c06c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:02.140824 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c73bb854-69f2-46d6-ac22-804fce55c06c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:02.273381 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c73bb854-69f2-46d6-ac22-804fce55c06c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:02.281363 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c73bb854-69f2-46d6-ac22-804fce55c06c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1363 microversion: 2.1 time: 0.153778 May 23 15:35:02.281926 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 343/692] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:02 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:03.298123 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c929e8c0-6833-4e0e-a045-9e346649d6b7 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:03.298680 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-c929e8c0-6833-4e0e-a045-9e346649d6b7 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:03.305136 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c929e8c0-6833-4e0e-a045-9e346649d6b7 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:03.305584 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c929e8c0-6833-4e0e-a045-9e346649d6b7 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:03.306343 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c929e8c0-6833-4e0e-a045-9e346649d6b7 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:03.306780 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c929e8c0-6833-4e0e-a045-9e346649d6b7 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:03.437134 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c929e8c0-6833-4e0e-a045-9e346649d6b7 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:03.444545 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-c929e8c0-6833-4e0e-a045-9e346649d6b7 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1363 microversion: 2.1 time: 0.151012 May 23 15:35:03.445256 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 350/693] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:03 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:03.977266 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-a572f648-4c74-492e-bcaf-5c216cc29a9a req-b2bdf498-74a3-4ed5-9cf2-b67f06c7d9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b2fc89f-88e8-42b3-9006-35470a9f74fc", "name": "network-vif-plugged", "status": "completed", "tag": "7781bf30-5eb4-4474-84ee-26a19cdd971e"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:35:03.986437 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-a572f648-4c74-492e-bcaf-5c216cc29a9a req-b2bdf498-74a3-4ed5-9cf2-b67f06c7d9ec service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:03.986886 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-a572f648-4c74-492e-bcaf-5c216cc29a9a req-b2bdf498-74a3-4ed5-9cf2-b67f06c7d9ec service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:03.998685 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-a572f648-4c74-492e-bcaf-5c216cc29a9a req-b2bdf498-74a3-4ed5-9cf2-b67f06c7d9ec service nova] Creating event network-vif-plugged:7781bf30-5eb4-4474-84ee-26a19cdd971e for instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc on hv-cinder-84112 May 23 15:35:04.003592 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-a572f648-4c74-492e-bcaf-5c216cc29a9a req-b2bdf498-74a3-4ed5-9cf2-b67f06c7d9ec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029993 May 23 15:35:04.004254 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 344/694] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:35:04.462133 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ab8ed35c-c492-48ea-a5f9-3e003697eb85 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:04.463004 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ab8ed35c-c492-48ea-a5f9-3e003697eb85 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:04.469457 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ab8ed35c-c492-48ea-a5f9-3e003697eb85 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:04.469856 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ab8ed35c-c492-48ea-a5f9-3e003697eb85 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:04.470628 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ab8ed35c-c492-48ea-a5f9-3e003697eb85 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:04.471071 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ab8ed35c-c492-48ea-a5f9-3e003697eb85 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:04.597347 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ab8ed35c-c492-48ea-a5f9-3e003697eb85 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:04.604843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ab8ed35c-c492-48ea-a5f9-3e003697eb85 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1363 microversion: 2.1 time: 0.146602 May 23 15:35:04.605445 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 351/695] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:04 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:05.619113 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=6 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:05.623338 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3d983c45-278d-4546-98f3-8f8a1900ce97 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:05.624046 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-3d983c45-278d-4546-98f3-8f8a1900ce97 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:05.630535 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3d983c45-278d-4546-98f3-8f8a1900ce97 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:05.630995 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3d983c45-278d-4546-98f3-8f8a1900ce97 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:05.631764 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3d983c45-278d-4546-98f3-8f8a1900ce97 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:05.632212 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3d983c45-278d-4546-98f3-8f8a1900ce97 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:05.771457 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3d983c45-278d-4546-98f3-8f8a1900ce97 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:05.778942 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-3d983c45-278d-4546-98f3-8f8a1900ce97 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1363 microversion: 2.1 time: 0.161239 May 23 15:35:05.779639 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 345/696] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:05 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:06.796231 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-da7aba83-1fc9-4bd7-a864-97720c9c5319 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:06.796845 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-da7aba83-1fc9-4bd7-a864-97720c9c5319 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:06.798818 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=2 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:06.799604 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=6 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:06.805673 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-da7aba83-1fc9-4bd7-a864-97720c9c5319 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:06.806127 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-da7aba83-1fc9-4bd7-a864-97720c9c5319 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:06.806899 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-da7aba83-1fc9-4bd7-a864-97720c9c5319 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:06.807342 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-da7aba83-1fc9-4bd7-a864-97720c9c5319 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:06.938969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-da7aba83-1fc9-4bd7-a864-97720c9c5319 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:06.947304 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-da7aba83-1fc9-4bd7-a864-97720c9c5319 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1548 microversion: 2.1 time: 0.155046 May 23 15:35:06.947871 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 352/697] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:06 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:06.965158 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8e333859-844a-4a1e-bd4e-e04b90ebbc33 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:06.965667 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8e333859-844a-4a1e-bd4e-e04b90ebbc33 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:06.974830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8e333859-844a-4a1e-bd4e-e04b90ebbc33 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:06.975499 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8e333859-844a-4a1e-bd4e-e04b90ebbc33 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:06.976291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8e333859-844a-4a1e-bd4e-e04b90ebbc33 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:06.976761 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8e333859-844a-4a1e-bd4e-e04b90ebbc33 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:07.069747 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8e333859-844a-4a1e-bd4e-e04b90ebbc33 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108658 May 23 15:35:07.070408 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 346/698] 10.222.0.30 () {58 vars in 1274 bytes} [Mon May 23 15:35:06 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:35:07.997867 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-b3cee0fb-de2d-4d49-a518-56e422267d4e req-f54d2515-8cec-402e-8f2b-2110651b7266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b2fc89f-88e8-42b3-9006-35470a9f74fc", "tag": "7781bf30-5eb4-4474-84ee-26a19cdd971e"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:35:08.006513 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-b3cee0fb-de2d-4d49-a518-56e422267d4e req-f54d2515-8cec-402e-8f2b-2110651b7266 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:08.007033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-b3cee0fb-de2d-4d49-a518-56e422267d4e req-f54d2515-8cec-402e-8f2b-2110651b7266 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:08.019166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-b3cee0fb-de2d-4d49-a518-56e422267d4e req-f54d2515-8cec-402e-8f2b-2110651b7266 service nova] Creating event network-changed:7781bf30-5eb4-4474-84ee-26a19cdd971e for instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc on hv-cinder-84112 May 23 15:35:08.024468 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-b3cee0fb-de2d-4d49-a518-56e422267d4e req-f54d2515-8cec-402e-8f2b-2110651b7266 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030280 May 23 15:35:08.025088 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 353/699] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:35:08.299718 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-75db5a27-09a4-4499-893c-01606db285de tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84d5ef4d-044c-4705-af68-18427c7dae15"}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:35:08.301561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-75db5a27-09a4-4499-893c-01606db285de tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:08.308560 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-75db5a27-09a4-4499-893c-01606db285de tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:08.309130 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-75db5a27-09a4-4499-893c-01606db285de tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:08.309981 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-75db5a27-09a4-4499-893c-01606db285de tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:08.310517 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-75db5a27-09a4-4499-893c-01606db285de tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:08.418527 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-75db5a27-09a4-4499-893c-01606db285de tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] HTTP exception thrown: Invalid volume: volume 84d5ef4d-044c-4705-af68-18427c7dae15 is already attached to instances: 1742ffd2-9b97-445d-94ad-da23deebac48 May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-75db5a27-09a4-4499-893c-01606db285de tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Request method failure captured: May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: POST /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48/os-volume_attachments HTTP/1.1 May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 74 May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6h_2ReNrnx1JyF_czjkEAP1FuuKwobsqEvhvInfqaSMw40CgNqIWA8A_vk7tsr0FV_LD0bCmm_eDbjudzYvptuB3YHMpvf76_Q9bPzPUDO6TB58uh-JSMbCrz2YGnMhaGsyJsPiGIuEP-UECWBwo39-BQHYqnkGew60A4fcmeNHaS8 May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:35:08.421175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:35:08.422842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2020e2bf35744af9161d7cf3e8bd345", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:35:08.422842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:35:08.422842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:35:08.422842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:35:08.422842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:35:08.422842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:35:08.422842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:35:08.422842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: 06431315dc8040cbbafbe83a3ed8e0e4 May 23 15:35:08.422842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:35:08.422842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: May 23 15:35:08.422842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {"volumeAttachment": {"volumeId": "84d5ef4d-044c-4705-af68-18427c7dae15"}} May 23 15:35:08.422842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Invalid volume: volume 84d5ef4d-044c-4705-af68-18427c7dae15 is already attached to instances: 1742ffd2-9b97-445d-94ad-da23deebac48 May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'server_id': '1742ffd2-9b97-445d-94ad-da23deebac48', 'body': {'volumeAttachment': {'volumeId': '84d5ef4d-044c-4705-af68-18427c7dae15'}}} May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 84d5ef4d-044c-4705-af68-18427c7dae15 is already attached to instances: 1742ffd2-9b97-445d-94ad-da23deebac48 May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:35:08.423695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 84d5ef4d-044c-4705-af68-18427c7dae15 is already attached to instances: 1742ffd2-9b97-445d-94ad-da23deebac48 May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:35:08.425053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:35:08.426409 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:35:08.426409 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:35:08.426409 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:35:08.426409 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 84d5ef4d-044c-4705-af68-18427c7dae15 is already attached to instances: 1742ffd2-9b97-445d-94ad-da23deebac48 May 23 15:35:08.426409 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:35:08.426409 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-75db5a27-09a4-4499-893c-01606db285de tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Returning 400 to user: Invalid volume: volume 84d5ef4d-044c-4705-af68-18427c7dae15 is already attached to instances: 1742ffd2-9b97-445d-94ad-da23deebac48 {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:35:08.426409 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-75db5a27-09a4-4499-893c-01606db285de tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "POST /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.129578 May 23 15:35:08.429764 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 347/700] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 15:35:08 2022] POST /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48/os-volume_attachments => generated 174 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 15:35:08.497499 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-0c0f1dc2-3648-4312-a377-e871510f5374 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:08.498925 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-0c0f1dc2-3648-4312-a377-e871510f5374 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:08.505700 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0c0f1dc2-3648-4312-a377-e871510f5374 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:08.506779 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0c0f1dc2-3648-4312-a377-e871510f5374 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:08.507956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0c0f1dc2-3648-4312-a377-e871510f5374 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:08.509012 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0c0f1dc2-3648-4312-a377-e871510f5374 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:08.595995 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-0c0f1dc2-3648-4312-a377-e871510f5374 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lazy-loading 'services' on Instance uuid 1742ffd2-9b97-445d-94ad-da23deebac48 {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:35:08.673300 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-0c0f1dc2-3648-4312-a377-e871510f5374 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48/os-volume_attachments/84d5ef4d-044c-4705-af68-18427c7dae15" status: 202 len: 0 microversion: 2.1 time: 0.180114 May 23 15:35:08.674335 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 354/701] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 15:35:08 2022] DELETE /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48/os-volume_attachments/84d5ef4d-044c-4705-af68-18427c7dae15 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:35:08.682765 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-816b7790-85d0-4799-9119-e10cfcc2f6ad tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:08.683780 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-816b7790-85d0-4799-9119-e10cfcc2f6ad tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:08.690692 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-816b7790-85d0-4799-9119-e10cfcc2f6ad tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:08.691461 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-816b7790-85d0-4799-9119-e10cfcc2f6ad tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:08.692496 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-816b7790-85d0-4799-9119-e10cfcc2f6ad tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:08.692898 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-816b7790-85d0-4799-9119-e10cfcc2f6ad tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:08.726233 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-816b7790-85d0-4799-9119-e10cfcc2f6ad tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047422 May 23 15:35:08.726824 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 348/702] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:35:08 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:35:09.743070 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-9082a203-8a22-4a81-9466-30d7bb3bdca1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:09.744180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-9082a203-8a22-4a81-9466-30d7bb3bdca1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:09.752136 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9082a203-8a22-4a81-9466-30d7bb3bdca1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:09.752913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9082a203-8a22-4a81-9466-30d7bb3bdca1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:09.754187 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9082a203-8a22-4a81-9466-30d7bb3bdca1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:09.754929 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9082a203-8a22-4a81-9466-30d7bb3bdca1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:09.788717 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-9082a203-8a22-4a81-9466-30d7bb3bdca1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051601 May 23 15:35:09.789307 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 355/703] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:35:09 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 23 15:35:09.854255 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5dbda6f7-5a9c-4808-860b-a64c58c42aea tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:09.854805 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-5dbda6f7-5a9c-4808-860b-a64c58c42aea tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:09.862090 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5dbda6f7-5a9c-4808-860b-a64c58c42aea tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:09.862464 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5dbda6f7-5a9c-4808-860b-a64c58c42aea tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:09.863232 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5dbda6f7-5a9c-4808-860b-a64c58c42aea tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:09.863667 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5dbda6f7-5a9c-4808-860b-a64c58c42aea tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:09.889978 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-5dbda6f7-5a9c-4808-860b-a64c58c42aea tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Going to try to terminate instance {{(pid=117973) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:35:09.968268 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-5dbda6f7-5a9c-4808-860b-a64c58c42aea tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 204 len: 0 microversion: 2.1 time: 0.118050 May 23 15:35:09.969065 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 349/704] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:35:09 2022] DELETE /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:35:09.977330 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f82cac1b-a169-4448-8aed-459e065df78a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:09.978011 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f82cac1b-a169-4448-8aed-459e065df78a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:09.985162 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f82cac1b-a169-4448-8aed-459e065df78a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:09.985620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f82cac1b-a169-4448-8aed-459e065df78a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:09.986396 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f82cac1b-a169-4448-8aed-459e065df78a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:09.986840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f82cac1b-a169-4448-8aed-459e065df78a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:10.117659 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-f82cac1b-a169-4448-8aed-459e065df78a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:10.120016 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:10.127243 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f82cac1b-a169-4448-8aed-459e065df78a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 200 len: 1680 microversion: 2.1 time: 0.153785 May 23 15:35:10.127826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 356/705] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:09 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:11.145205 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-93c92405-f1ff-4b01-8b1e-c3528d62fc89 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:11.145918 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-93c92405-f1ff-4b01-8b1e-c3528d62fc89 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:11.152328 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-93c92405-f1ff-4b01-8b1e-c3528d62fc89 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:11.152784 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-93c92405-f1ff-4b01-8b1e-c3528d62fc89 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:11.153691 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-93c92405-f1ff-4b01-8b1e-c3528d62fc89 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:11.154139 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-93c92405-f1ff-4b01-8b1e-c3528d62fc89 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:11.288452 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-93c92405-f1ff-4b01-8b1e-c3528d62fc89 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:11.296535 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-93c92405-f1ff-4b01-8b1e-c3528d62fc89 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 200 len: 1680 microversion: 2.1 time: 0.155947 May 23 15:35:11.297130 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 350/706] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:11 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:35:12.314968 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-21a642e1-6d80-4e10-a9ff-b6d9b8243871 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:12.315585 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-21a642e1-6d80-4e10-a9ff-b6d9b8243871 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:12.317896 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:12.324294 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-21a642e1-6d80-4e10-a9ff-b6d9b8243871 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:12.324743 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-21a642e1-6d80-4e10-a9ff-b6d9b8243871 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:12.325548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-21a642e1-6d80-4e10-a9ff-b6d9b8243871 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:12.325989 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-21a642e1-6d80-4e10-a9ff-b6d9b8243871 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:12.777500 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-21a642e1-6d80-4e10-a9ff-b6d9b8243871 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:12.785689 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-21a642e1-6d80-4e10-a9ff-b6d9b8243871 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 200 len: 1680 microversion: 2.1 time: 0.475581 May 23 15:35:12.786257 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 357/707] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:12 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 1680 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:13.237772 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-7b88ea9a-1900-4269-947f-be9f5bde7df4 req-9147314d-28ab-4286-984b-65935947f966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1742ffd2-9b97-445d-94ad-da23deebac48", "name": "network-vif-deleted", "tag": "6fea56fd-ce2d-491d-b530-af4a33a7b17e"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:35:13.246114 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-7b88ea9a-1900-4269-947f-be9f5bde7df4 req-9147314d-28ab-4286-984b-65935947f966 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:13.246628 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-7b88ea9a-1900-4269-947f-be9f5bde7df4 req-9147314d-28ab-4286-984b-65935947f966 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:13.262865 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-7b88ea9a-1900-4269-947f-be9f5bde7df4 req-9147314d-28ab-4286-984b-65935947f966 service nova] Creating event network-vif-deleted:6fea56fd-ce2d-491d-b530-af4a33a7b17e for instance 1742ffd2-9b97-445d-94ad-da23deebac48 on hv-cinder-84112 May 23 15:35:13.274450 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-7b88ea9a-1900-4269-947f-be9f5bde7df4 req-9147314d-28ab-4286-984b-65935947f966 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106470 May 23 15:35:13.275764 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 351/708] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:35:13.802938 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-62198b61-9b35-4695-b6fd-acf281712b98 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:13.803544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-62198b61-9b35-4695-b6fd-acf281712b98 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:13.815548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-62198b61-9b35-4695-b6fd-acf281712b98 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:13.816039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-62198b61-9b35-4695-b6fd-acf281712b98 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:13.817039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-62198b61-9b35-4695-b6fd-acf281712b98 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:13.817597 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-62198b61-9b35-4695-b6fd-acf281712b98 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:13.837857 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-62198b61-9b35-4695-b6fd-acf281712b98 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] HTTP exception thrown: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-62198b61-9b35-4695-b6fd-acf281712b98 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Request method failure captured: May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 HTTP/1.1 May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6h_2ReNrnx1JyF_czjkEAP1FuuKwobsqEvhvInfqaSMw40CgNqIWA8A_vk7tsr0FV_LD0bCmm_eDbjudzYvptuB3YHMpvf76_Q9bPzPUDO6TB58uh-JSMbCrz2YGnMhaGsyJsPiGIuEP-UECWBwo39-BQHYqnkGew60A4fcmeNHaS8 May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:35:13.839763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:35:13.841368 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2020e2bf35744af9161d7cf3e8bd345", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:35:13.841368 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:35:13.841368 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:35:13.841368 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:35:13.841368 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:35:13.841368 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:35:13.841368 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:35:13.841368 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 06431315dc8040cbbafbe83a3ed8e0e4 May 23 15:35:13.841368 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:35:13.841368 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:35:13.841368 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. May 23 15:35:13.841368 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '1742ffd2-9b97-445d-94ad-da23deebac48'} May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:35:13.842993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. May 23 15:35:13.844595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:13.845873 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-62198b61-9b35-4695-b6fd-acf281712b98 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Returning 404 to user: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:35:13.845873 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-62198b61-9b35-4695-b6fd-acf281712b98 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 404 len: 111 microversion: 2.1 time: 0.042682 May 23 15:35:13.845873 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 358/709] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:13 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:35:13.851281 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-bb3d3373-1092-4211-b393-c26f15d6cbf8 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '.version_select at 0x7f0d7a21ddc0>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:13.870121 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-bb3d3373-1092-4211-b393-c26f15d6cbf8 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1878670788" status: 202 len: 0 microversion: 2.1 time: 0.022994 May 23 15:35:13.870704 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 352/710] 10.222.0.30 () {58 vars in 1220 bytes} [Mon May 23 15:35:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1878670788 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:35:14.496138 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5e2b3846-30dc-4647-b066-463f49f6540f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Action: 'create', calling method: .version_select at 0x7f0d7a3e2430>, body: {"keypair": {"name": "tempest-keypair-2061153375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8FSPeO4AQ0pyJ1pYbsWOzVI7uVEikxo8sCg6Ugpr3BM4rZjXpOMHUEeviYj23tq3yvCzWEptY9B6tbEMu6HbQJwfOJvKnrnNy1o4mG+nK2KgmjGHvg2a9UDUUp9iw8CQ=="}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:35:14.510374 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-5e2b3846-30dc-4647-b066-463f49f6540f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Getting quotas for project f2020e2bf35744af9161d7cf3e8bd345. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:35:14.515025 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-5e2b3846-30dc-4647-b066-463f49f6540f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Getting quotas for user 06431315dc8040cbbafbe83a3ed8e0e4 and project f2020e2bf35744af9161d7cf3e8bd345. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:35:14.537374 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5e2b3846-30dc-4647-b066-463f49f6540f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045186 May 23 15:35:14.537966 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 359/711] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 15:35:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:35:15.806414 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-23537603-3976-4c4d-8e67-5561771c93fd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1382317506", "imageRef": "807d39e3-2293-48ca-b2cd-675f7c931014", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9306d40-6dd5-4f4d-bb55-9077bd7b986d"}], "security_groups": [{"name": "tempest-securitygroup--94558504"}], "key_name": "tempest-keypair-2061153375", "user_data": "}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:35:15.917967 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.network.neutron [None req-23537603-3976-4c4d-8e67-5561771c93fd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] validate_networks() for [('c9306d40-6dd5-4f4d-bb55-9077bd7b986d', None, None, None, None, None)] {{(pid=117973) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:35:16.330676 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-23537603-3976-4c4d-8e67-5561771c93fd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Flavor limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:35:16.331104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-23537603-3976-4c4d-8e67-5561771c93fd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Image limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:35:16.331672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-23537603-3976-4c4d-8e67-5561771c93fd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Flavor pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:35:16.332034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-23537603-3976-4c4d-8e67-5561771c93fd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Image pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:35:16.332450 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-23537603-3976-4c4d-8e67-5561771c93fd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:35:16.341404 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-23537603-3976-4c4d-8e67-5561771c93fd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:16.341862 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-23537603-3976-4c4d-8e67-5561771c93fd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:16.342671 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-23537603-3976-4c4d-8e67-5561771c93fd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:16.343115 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-23537603-3976-4c4d-8e67-5561771c93fd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:16.360294 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-23537603-3976-4c4d-8e67-5561771c93fd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Getting quotas for project f2020e2bf35744af9161d7cf3e8bd345. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:35:16.364282 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-23537603-3976-4c4d-8e67-5561771c93fd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Getting quotas for user 06431315dc8040cbbafbe83a3ed8e0e4 and project f2020e2bf35744af9161d7cf3e8bd345. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:35:16.376184 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-23537603-3976-4c4d-8e67-5561771c93fd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Going to run 1 instances... {{(pid=117973) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:35:16.378565 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-23537603-3976-4c4d-8e67-5561771c93fd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='807d39e3-2293-48ca-b2cd-675f7c931014',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:35:16.424352 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-23537603-3976-4c4d-8e67-5561771c93fd tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.622669 May 23 15:35:16.425008 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 353/712] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:35:15 2022] POST /compute/v2.1/servers => generated 400 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:35:16.435229 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ec9e6cea-9c48-4b42-a288-1323ed2ca6ef tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:16.436488 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ec9e6cea-9c48-4b42-a288-1323ed2ca6ef tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:16.493614 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ec9e6cea-9c48-4b42-a288-1323ed2ca6ef tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:16.502066 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ec9e6cea-9c48-4b42-a288-1323ed2ca6ef tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 200 len: 1242 microversion: 2.1 time: 0.070782 May 23 15:35:16.502643 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 360/713] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:16 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:35:17.519634 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-9bc4ad35-078c-4558-9cab-1f2ed8369c1f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:17.520511 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-9bc4ad35-078c-4558-9cab-1f2ed8369c1f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:17.528106 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9bc4ad35-078c-4558-9cab-1f2ed8369c1f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:17.528594 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9bc4ad35-078c-4558-9cab-1f2ed8369c1f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:17.529531 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9bc4ad35-078c-4558-9cab-1f2ed8369c1f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:17.530103 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9bc4ad35-078c-4558-9cab-1f2ed8369c1f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:17.534071 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:17.599504 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9bc4ad35-078c-4558-9cab-1f2ed8369c1f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:17.608414 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-9bc4ad35-078c-4558-9cab-1f2ed8369c1f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 200 len: 1302 microversion: 2.1 time: 0.093199 May 23 15:35:17.609094 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 354/714] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:17 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 1302 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:18.625887 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-1d5fdbc9-bb61-44df-b73f-3af1301f43dc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:18.626602 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-1d5fdbc9-bb61-44df-b73f-3af1301f43dc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:18.633279 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1d5fdbc9-bb61-44df-b73f-3af1301f43dc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:18.633726 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1d5fdbc9-bb61-44df-b73f-3af1301f43dc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:18.634530 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1d5fdbc9-bb61-44df-b73f-3af1301f43dc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:18.634961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1d5fdbc9-bb61-44df-b73f-3af1301f43dc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:18.813462 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1d5fdbc9-bb61-44df-b73f-3af1301f43dc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:18.821160 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-1d5fdbc9-bb61-44df-b73f-3af1301f43dc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 200 len: 1366 microversion: 2.1 time: 0.199318 May 23 15:35:18.821938 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 361/715] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:18 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:19.140956 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-ee0bd6de-e3a2-4d46-b4a1-7b765e0b5d70 req-9375de33-5c40-4385-8fa2-fb8b65f7b173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cb5b773-cad7-4825-8550-efc0cebf77ac", "tag": "9da9d834-ba1e-4927-8127-fb201067194c"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:35:19.150163 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-ee0bd6de-e3a2-4d46-b4a1-7b765e0b5d70 req-9375de33-5c40-4385-8fa2-fb8b65f7b173 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:19.150625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-ee0bd6de-e3a2-4d46-b4a1-7b765e0b5d70 req-9375de33-5c40-4385-8fa2-fb8b65f7b173 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:19.167067 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-ee0bd6de-e3a2-4d46-b4a1-7b765e0b5d70 req-9375de33-5c40-4385-8fa2-fb8b65f7b173 service nova] Creating event network-changed:9da9d834-ba1e-4927-8127-fb201067194c for instance 7cb5b773-cad7-4825-8550-efc0cebf77ac on hv-cinder-84112 May 23 15:35:19.173200 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-ee0bd6de-e3a2-4d46-b4a1-7b765e0b5d70 req-9375de33-5c40-4385-8fa2-fb8b65f7b173 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036571 May 23 15:35:19.173738 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 355/716] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:35:19.839281 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d0faec30-1f41-46ab-aab7-2f13f5e73ce7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:19.839889 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d0faec30-1f41-46ab-aab7-2f13f5e73ce7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:19.847061 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d0faec30-1f41-46ab-aab7-2f13f5e73ce7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:19.847503 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d0faec30-1f41-46ab-aab7-2f13f5e73ce7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:19.848260 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d0faec30-1f41-46ab-aab7-2f13f5e73ce7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:19.848690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d0faec30-1f41-46ab-aab7-2f13f5e73ce7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:19.980454 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d0faec30-1f41-46ab-aab7-2f13f5e73ce7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:19.988474 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d0faec30-1f41-46ab-aab7-2f13f5e73ce7 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 200 len: 1366 microversion: 2.1 time: 0.153236 May 23 15:35:19.989069 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 362/717] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:19 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:21.006132 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7ec40044-aa1f-45ed-8ab2-6e8f1243e7fa tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:21.006851 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7ec40044-aa1f-45ed-8ab2-6e8f1243e7fa tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:21.013202 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7ec40044-aa1f-45ed-8ab2-6e8f1243e7fa tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:21.013665 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7ec40044-aa1f-45ed-8ab2-6e8f1243e7fa tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:21.015231 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7ec40044-aa1f-45ed-8ab2-6e8f1243e7fa tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:21.015683 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7ec40044-aa1f-45ed-8ab2-6e8f1243e7fa tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:21.147494 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-7ec40044-aa1f-45ed-8ab2-6e8f1243e7fa tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:21.155403 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7ec40044-aa1f-45ed-8ab2-6e8f1243e7fa tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 200 len: 1366 microversion: 2.1 time: 0.153473 May 23 15:35:21.156074 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 356/718] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:21 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:22.036983 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-566a7e68-67c5-4163-8e26-2e3fd7af3e8d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:22.037486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-566a7e68-67c5-4163-8e26-2e3fd7af3e8d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:22.043401 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-566a7e68-67c5-4163-8e26-2e3fd7af3e8d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:22.043852 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-566a7e68-67c5-4163-8e26-2e3fd7af3e8d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:22.044625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-566a7e68-67c5-4163-8e26-2e3fd7af3e8d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:22.045717 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-566a7e68-67c5-4163-8e26-2e3fd7af3e8d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:22.068542 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-566a7e68-67c5-4163-8e26-2e3fd7af3e8d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285/ips" status: 200 len: 152 microversion: 2.20 time: 0.184123 May 23 15:35:22.069139 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 363/719] 10.222.0.30 () {60 vars in 1288 bytes} [Mon May 23 15:35:21 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285/ips => generated 152 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:35:22.172075 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-6a248937-90bb-4392-960b-8eaa2c1b86d9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:22.172688 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-6a248937-90bb-4392-960b-8eaa2c1b86d9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:22.179078 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6a248937-90bb-4392-960b-8eaa2c1b86d9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:22.179529 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6a248937-90bb-4392-960b-8eaa2c1b86d9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:22.180294 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6a248937-90bb-4392-960b-8eaa2c1b86d9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:22.180730 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6a248937-90bb-4392-960b-8eaa2c1b86d9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:22.338282 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-6a248937-90bb-4392-960b-8eaa2c1b86d9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:22.349810 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-6a248937-90bb-4392-960b-8eaa2c1b86d9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 200 len: 1366 microversion: 2.1 time: 0.182085 May 23 15:35:22.350466 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 357/720] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:22 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:23.367274 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d983f3eb-f5f4-4d9b-985b-6e54a31cf223 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:23.368090 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d983f3eb-f5f4-4d9b-985b-6e54a31cf223 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:23.374858 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d983f3eb-f5f4-4d9b-985b-6e54a31cf223 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:23.375313 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d983f3eb-f5f4-4d9b-985b-6e54a31cf223 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:23.376096 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d983f3eb-f5f4-4d9b-985b-6e54a31cf223 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:23.377661 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d983f3eb-f5f4-4d9b-985b-6e54a31cf223 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:23.513277 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d983f3eb-f5f4-4d9b-985b-6e54a31cf223 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:23.521612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d983f3eb-f5f4-4d9b-985b-6e54a31cf223 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 200 len: 1366 microversion: 2.1 time: 0.158364 May 23 15:35:23.522173 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 364/721] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:23 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:24.020474 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-29c6c98d-af96-41ae-94c9-1ebfb2afe28a req-6ec16464-559c-4799-af1f-f3c260027914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb5b773-cad7-4825-8550-efc0cebf77ac", "name": "network-vif-plugged", "status": "completed", "tag": "9da9d834-ba1e-4927-8127-fb201067194c"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:35:24.029954 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-29c6c98d-af96-41ae-94c9-1ebfb2afe28a req-6ec16464-559c-4799-af1f-f3c260027914 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:24.030457 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-29c6c98d-af96-41ae-94c9-1ebfb2afe28a req-6ec16464-559c-4799-af1f-f3c260027914 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:24.043211 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-29c6c98d-af96-41ae-94c9-1ebfb2afe28a req-6ec16464-559c-4799-af1f-f3c260027914 service nova] Creating event network-vif-plugged:9da9d834-ba1e-4927-8127-fb201067194c for instance 7cb5b773-cad7-4825-8550-efc0cebf77ac on hv-cinder-84112 May 23 15:35:24.048778 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-29c6c98d-af96-41ae-94c9-1ebfb2afe28a req-6ec16464-559c-4799-af1f-f3c260027914 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032345 May 23 15:35:24.049762 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 358/722] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:35:24.104514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-df206f19-538e-418c-afab-6d041b094a04 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:35:24.105310 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-df206f19-538e-418c-afab-6d041b094a04 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:24.111941 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-df206f19-538e-418c-afab-6d041b094a04 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:24.112393 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-df206f19-538e-418c-afab-6d041b094a04 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:24.113221 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-df206f19-538e-418c-afab-6d041b094a04 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:24.113655 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-df206f19-538e-418c-afab-6d041b094a04 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:24.137190 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-df206f19-538e-418c-afab-6d041b094a04 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lazy-loading 'flavor' on Instance uuid 7f5c3bd6-1b7d-4c25-a705-2291f6709285 {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:35:24.394853 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-df206f19-538e-418c-afab-6d041b094a04 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "POST /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285/action" status: 202 len: 0 microversion: 2.20 time: 0.294192 May 23 15:35:24.395728 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 365/723] 10.222.0.30 () {62 vars in 1318 bytes} [Mon May 23 15:35:24 2022] POST /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 15:35:24.404249 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ef4e0e35-8be2-4bf8-8476-c13fb16d8408 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:24.405729 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ef4e0e35-8be2-4bf8-8476-c13fb16d8408 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:24.412131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ef4e0e35-8be2-4bf8-8476-c13fb16d8408 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:24.412593 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ef4e0e35-8be2-4bf8-8476-c13fb16d8408 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:24.413418 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ef4e0e35-8be2-4bf8-8476-c13fb16d8408 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:24.413869 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ef4e0e35-8be2-4bf8-8476-c13fb16d8408 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:24.538381 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-bfcc4e8a-3809-4b22-99dc-b1f03a6b2aca tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:24.539229 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-bfcc4e8a-3809-4b22-99dc-b1f03a6b2aca tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:24.546383 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bfcc4e8a-3809-4b22-99dc-b1f03a6b2aca tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:24.546911 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bfcc4e8a-3809-4b22-99dc-b1f03a6b2aca tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:24.547204 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ef4e0e35-8be2-4bf8-8476-c13fb16d8408 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:24.547877 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bfcc4e8a-3809-4b22-99dc-b1f03a6b2aca tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:24.548379 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bfcc4e8a-3809-4b22-99dc-b1f03a6b2aca tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:24.555166 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ef4e0e35-8be2-4bf8-8476-c13fb16d8408 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:24.556682 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ef4e0e35-8be2-4bf8-8476-c13fb16d8408 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:24.557889 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ef4e0e35-8be2-4bf8-8476-c13fb16d8408 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1724 microversion: 2.20 time: 0.157822 May 23 15:35:24.558461 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 359/724] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:24 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:24.677628 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-bfcc4e8a-3809-4b22-99dc-b1f03a6b2aca tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:24.685142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-bfcc4e8a-3809-4b22-99dc-b1f03a6b2aca tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 200 len: 1366 microversion: 2.1 time: 0.151026 May 23 15:35:24.685750 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 366/725] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:24 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:35:25.576091 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-edb6ba09-4a80-4a28-8a8c-64e4b11a8f0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:25.577571 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-edb6ba09-4a80-4a28-8a8c-64e4b11a8f0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:25.584269 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-edb6ba09-4a80-4a28-8a8c-64e4b11a8f0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:25.585003 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-edb6ba09-4a80-4a28-8a8c-64e4b11a8f0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:25.585588 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-edb6ba09-4a80-4a28-8a8c-64e4b11a8f0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:25.586133 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-edb6ba09-4a80-4a28-8a8c-64e4b11a8f0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:25.702758 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4e6d9e02-ccaf-49b9-b1f9-9b776508a65f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:25.704227 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4e6d9e02-ccaf-49b9-b1f9-9b776508a65f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:25.712403 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4e6d9e02-ccaf-49b9-b1f9-9b776508a65f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:25.712854 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4e6d9e02-ccaf-49b9-b1f9-9b776508a65f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:25.713653 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4e6d9e02-ccaf-49b9-b1f9-9b776508a65f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:25.714098 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4e6d9e02-ccaf-49b9-b1f9-9b776508a65f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:25.746988 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-edb6ba09-4a80-4a28-8a8c-64e4b11a8f0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:25.757038 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-edb6ba09-4a80-4a28-8a8c-64e4b11a8f0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:25.758687 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-edb6ba09-4a80-4a28-8a8c-64e4b11a8f0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:25.759953 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-edb6ba09-4a80-4a28-8a8c-64e4b11a8f0e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1724 microversion: 2.20 time: 0.187747 May 23 15:35:25.760587 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 360/726] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:25 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:25.766336 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5a3295fb-a996-4141-9695-05e8bba28c3f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:25.767531 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-5a3295fb-a996-4141-9695-05e8bba28c3f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:25.774316 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5a3295fb-a996-4141-9695-05e8bba28c3f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:25.774776 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5a3295fb-a996-4141-9695-05e8bba28c3f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:25.775553 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5a3295fb-a996-4141-9695-05e8bba28c3f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:25.776000 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5a3295fb-a996-4141-9695-05e8bba28c3f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:25.857325 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4e6d9e02-ccaf-49b9-b1f9-9b776508a65f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:25.859344 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.objects.instance [None req-5a3295fb-a996-4141-9695-05e8bba28c3f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lazy-loading 'services' on Instance uuid bb26539d-bd10-48dd-9c5d-433060babfb6 {{(pid=117973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:35:25.865541 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4e6d9e02-ccaf-49b9-b1f9-9b776508a65f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 200 len: 1555 microversion: 2.1 time: 0.167876 May 23 15:35:25.866106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 367/727] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:25 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:35:25.881535 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-946882bf-f608-4d7c-b770-7d2175cc027b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:25.882035 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-946882bf-f608-4d7c-b770-7d2175cc027b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:25.887921 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-946882bf-f608-4d7c-b770-7d2175cc027b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:25.888371 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-946882bf-f608-4d7c-b770-7d2175cc027b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:25.889162 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-946882bf-f608-4d7c-b770-7d2175cc027b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:25.889595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-946882bf-f608-4d7c-b770-7d2175cc027b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:25.932044 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-5a3295fb-a996-4141-9695-05e8bba28c3f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/os-volume_attachments/393eef02-5358-419b-bd2d-0dcf6259445e" status: 202 len: 0 microversion: 2.1 time: 0.170014 May 23 15:35:25.932565 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 361/728] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 15:35:25 2022] DELETE /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/os-volume_attachments/393eef02-5358-419b-bd2d-0dcf6259445e => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:35:25.941275 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ca2efac5-c8e0-4516-aa67-fd7e5cd7b15a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:25.942333 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ca2efac5-c8e0-4516-aa67-fd7e5cd7b15a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:25.948596 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ca2efac5-c8e0-4516-aa67-fd7e5cd7b15a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:25.949087 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ca2efac5-c8e0-4516-aa67-fd7e5cd7b15a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:25.949859 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ca2efac5-c8e0-4516-aa67-fd7e5cd7b15a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:25.950299 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ca2efac5-c8e0-4516-aa67-fd7e5cd7b15a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:25.972318 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-946882bf-f608-4d7c-b770-7d2175cc027b tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094347 May 23 15:35:25.972948 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 368/729] 10.222.0.30 () {58 vars in 1274 bytes} [Mon May 23 15:35:25 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:35:25.986068 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ca2efac5-c8e0-4516-aa67-fd7e5cd7b15a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048828 May 23 15:35:25.987514 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 362/730] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:35:25 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:35:26.776637 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=6 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:26.782047 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-53579c54-31c5-42c4-95cf-a681f69fdbfc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:26.782699 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-53579c54-31c5-42c4-95cf-a681f69fdbfc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:26.789381 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-53579c54-31c5-42c4-95cf-a681f69fdbfc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:26.789835 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-53579c54-31c5-42c4-95cf-a681f69fdbfc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:26.790678 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-53579c54-31c5-42c4-95cf-a681f69fdbfc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:26.791059 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-53579c54-31c5-42c4-95cf-a681f69fdbfc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:26.942761 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-53579c54-31c5-42c4-95cf-a681f69fdbfc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:26.951118 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-53579c54-31c5-42c4-95cf-a681f69fdbfc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:26.953313 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-53579c54-31c5-42c4-95cf-a681f69fdbfc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:26.954501 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-53579c54-31c5-42c4-95cf-a681f69fdbfc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1724 microversion: 2.20 time: 0.178750 May 23 15:35:26.955065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 369/731] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:26 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:26.997112 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-73191ab2-5a11-47d2-b262-2956f739eb53 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:26.998134 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-73191ab2-5a11-47d2-b262-2956f739eb53 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:27.001187 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:27.002086 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=6 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:27.008929 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-73191ab2-5a11-47d2-b262-2956f739eb53 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:27.009388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-73191ab2-5a11-47d2-b262-2956f739eb53 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:27.010168 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-73191ab2-5a11-47d2-b262-2956f739eb53 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:27.010606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-73191ab2-5a11-47d2-b262-2956f739eb53 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:27.040498 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-73191ab2-5a11-47d2-b262-2956f739eb53 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047687 May 23 15:35:27.041179 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 363/732] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:35:26 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:35:27.143937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-cfb8cf03-0280-414e-9fcc-8f872da93747 req-9511e044-bc52-406b-93de-475e52a6357f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cb5b773-cad7-4825-8550-efc0cebf77ac", "tag": "9da9d834-ba1e-4927-8127-fb201067194c"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:35:27.152404 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-cfb8cf03-0280-414e-9fcc-8f872da93747 req-9511e044-bc52-406b-93de-475e52a6357f service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:27.152852 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-cfb8cf03-0280-414e-9fcc-8f872da93747 req-9511e044-bc52-406b-93de-475e52a6357f service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:27.164787 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-cfb8cf03-0280-414e-9fcc-8f872da93747 req-9511e044-bc52-406b-93de-475e52a6357f service nova] Creating event network-changed:9da9d834-ba1e-4927-8127-fb201067194c for instance 7cb5b773-cad7-4825-8550-efc0cebf77ac on hv-cinder-84112 May 23 15:35:27.169665 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-cfb8cf03-0280-414e-9fcc-8f872da93747 req-9511e044-bc52-406b-93de-475e52a6357f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029617 May 23 15:35:27.170776 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 370/733] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:35:27.973368 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3861aed4-edc3-4d58-bdde-9e564690c3b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:27.973993 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-3861aed4-edc3-4d58-bdde-9e564690c3b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:27.975818 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:27.981050 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3861aed4-edc3-4d58-bdde-9e564690c3b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:27.981505 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3861aed4-edc3-4d58-bdde-9e564690c3b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:27.982270 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3861aed4-edc3-4d58-bdde-9e564690c3b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:27.982797 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3861aed4-edc3-4d58-bdde-9e564690c3b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:28.053037 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-19ec7ff8-c416-40af-bf5c-b8a4dd79eefa tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:28.054176 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-19ec7ff8-c416-40af-bf5c-b8a4dd79eefa tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:28.062541 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-19ec7ff8-c416-40af-bf5c-b8a4dd79eefa tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:28.063127 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-19ec7ff8-c416-40af-bf5c-b8a4dd79eefa tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:28.064849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-19ec7ff8-c416-40af-bf5c-b8a4dd79eefa tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:28.065466 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-19ec7ff8-c416-40af-bf5c-b8a4dd79eefa tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:28.108907 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-19ec7ff8-c416-40af-bf5c-b8a4dd79eefa tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060696 May 23 15:35:28.109532 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 371/734] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:35:28 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 23 15:35:28.133760 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3861aed4-edc3-4d58-bdde-9e564690c3b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:28.143562 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3861aed4-edc3-4d58-bdde-9e564690c3b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:28.145713 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3861aed4-edc3-4d58-bdde-9e564690c3b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:28.146996 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-3861aed4-edc3-4d58-bdde-9e564690c3b4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1724 microversion: 2.20 time: 0.177624 May 23 15:35:28.147957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 364/735] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:27 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:28.187541 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f7539a28-c45a-4101-9659-6f678ea6552a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:28.187978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f7539a28-c45a-4101-9659-6f678ea6552a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:28.194147 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f7539a28-c45a-4101-9659-6f678ea6552a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:28.194628 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f7539a28-c45a-4101-9659-6f678ea6552a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:28.195404 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f7539a28-c45a-4101-9659-6f678ea6552a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:28.195845 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f7539a28-c45a-4101-9659-6f678ea6552a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:28.222788 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f7539a28-c45a-4101-9659-6f678ea6552a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Going to try to terminate instance {{(pid=117974) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:35:28.299759 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f7539a28-c45a-4101-9659-6f678ea6552a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 204 len: 0 microversion: 2.1 time: 0.116549 May 23 15:35:28.303909 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 372/736] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:35:28 2022] DELETE /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:35:28.309257 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-297e0945-c790-4414-987b-da9dbf992dab tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:28.309907 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-297e0945-c790-4414-987b-da9dbf992dab tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:28.316598 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-297e0945-c790-4414-987b-da9dbf992dab tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:28.317171 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-297e0945-c790-4414-987b-da9dbf992dab tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:28.318083 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-297e0945-c790-4414-987b-da9dbf992dab tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:28.318600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-297e0945-c790-4414-987b-da9dbf992dab tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:28.454876 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-297e0945-c790-4414-987b-da9dbf992dab tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:28.462485 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-297e0945-c790-4414-987b-da9dbf992dab tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1689 microversion: 2.1 time: 0.157534 May 23 15:35:28.463055 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 365/737] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:28 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:29.166210 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c01c31d2-a77e-46fa-b58f-529f8479c978 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:29.166917 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-c01c31d2-a77e-46fa-b58f-529f8479c978 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:29.174167 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c01c31d2-a77e-46fa-b58f-529f8479c978 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:29.174622 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c01c31d2-a77e-46fa-b58f-529f8479c978 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:29.175390 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c01c31d2-a77e-46fa-b58f-529f8479c978 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:29.175830 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c01c31d2-a77e-46fa-b58f-529f8479c978 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:29.315100 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c01c31d2-a77e-46fa-b58f-529f8479c978 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:29.317480 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:29.325461 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c01c31d2-a77e-46fa-b58f-529f8479c978 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:29.326989 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c01c31d2-a77e-46fa-b58f-529f8479c978 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:29.328169 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-c01c31d2-a77e-46fa-b58f-529f8479c978 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1724 microversion: 2.20 time: 0.166372 May 23 15:35:29.328723 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 373/738] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:29 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:29.480242 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7d9d5c10-4dab-4c5d-a821-e0058acd348a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:29.480778 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7d9d5c10-4dab-4c5d-a821-e0058acd348a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:29.487914 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7d9d5c10-4dab-4c5d-a821-e0058acd348a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:29.488397 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7d9d5c10-4dab-4c5d-a821-e0058acd348a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:29.489202 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7d9d5c10-4dab-4c5d-a821-e0058acd348a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:29.489649 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7d9d5c10-4dab-4c5d-a821-e0058acd348a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:29.616276 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-7d9d5c10-4dab-4c5d-a821-e0058acd348a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:29.623787 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7d9d5c10-4dab-4c5d-a821-e0058acd348a tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1689 microversion: 2.1 time: 0.147452 May 23 15:35:29.624443 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 366/739] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:29 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:30.347301 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ca7d82ee-b99e-4f59-85f1-40df30501fc4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:30.348479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ca7d82ee-b99e-4f59-85f1-40df30501fc4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:30.355476 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ca7d82ee-b99e-4f59-85f1-40df30501fc4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:30.356013 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ca7d82ee-b99e-4f59-85f1-40df30501fc4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:30.356785 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ca7d82ee-b99e-4f59-85f1-40df30501fc4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:30.357258 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ca7d82ee-b99e-4f59-85f1-40df30501fc4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:30.485611 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ca7d82ee-b99e-4f59-85f1-40df30501fc4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:30.493607 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ca7d82ee-b99e-4f59-85f1-40df30501fc4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:30.495055 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ca7d82ee-b99e-4f59-85f1-40df30501fc4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:30.496219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ca7d82ee-b99e-4f59-85f1-40df30501fc4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1724 microversion: 2.20 time: 0.153867 May 23 15:35:30.496784 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 374/740] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:30 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:30.641466 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b571a0a8-3ed1-4afe-bd11-966505d3f136 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:30.642085 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b571a0a8-3ed1-4afe-bd11-966505d3f136 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:30.649119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b571a0a8-3ed1-4afe-bd11-966505d3f136 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:30.649582 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b571a0a8-3ed1-4afe-bd11-966505d3f136 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:30.650358 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b571a0a8-3ed1-4afe-bd11-966505d3f136 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:30.650806 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b571a0a8-3ed1-4afe-bd11-966505d3f136 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:30.777823 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b571a0a8-3ed1-4afe-bd11-966505d3f136 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:30.785889 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b571a0a8-3ed1-4afe-bd11-966505d3f136 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1689 microversion: 2.1 time: 0.148975 May 23 15:35:30.786459 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 367/741] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:30 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:31.515581 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-76946b94-d5d3-4b97-9bdc-5cfde2a72185 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:31.516199 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-76946b94-d5d3-4b97-9bdc-5cfde2a72185 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:31.523381 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-76946b94-d5d3-4b97-9bdc-5cfde2a72185 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:31.523836 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-76946b94-d5d3-4b97-9bdc-5cfde2a72185 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:31.524602 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-76946b94-d5d3-4b97-9bdc-5cfde2a72185 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:31.525077 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-76946b94-d5d3-4b97-9bdc-5cfde2a72185 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:31.652205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-76946b94-d5d3-4b97-9bdc-5cfde2a72185 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:31.660918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-76946b94-d5d3-4b97-9bdc-5cfde2a72185 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:31.662436 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-76946b94-d5d3-4b97-9bdc-5cfde2a72185 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:31.663611 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-76946b94-d5d3-4b97-9bdc-5cfde2a72185 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1724 microversion: 2.20 time: 0.152658 May 23 15:35:31.664176 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 375/742] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:31 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:35:31.802706 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-86818d6f-4929-4c2a-975b-70e251a95e84 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:31.803303 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-86818d6f-4929-4c2a-975b-70e251a95e84 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:31.809829 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86818d6f-4929-4c2a-975b-70e251a95e84 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:31.810278 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86818d6f-4929-4c2a-975b-70e251a95e84 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:31.811166 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86818d6f-4929-4c2a-975b-70e251a95e84 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:31.811608 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86818d6f-4929-4c2a-975b-70e251a95e84 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:31.941999 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-86818d6f-4929-4c2a-975b-70e251a95e84 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:31.949912 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-86818d6f-4929-4c2a-975b-70e251a95e84 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1689 microversion: 2.1 time: 0.151189 May 23 15:35:31.950525 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 368/743] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:31 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:32.682396 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-68093075-fb2c-4f1f-8864-a1ccd9c5b20f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:32.683018 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-68093075-fb2c-4f1f-8864-a1ccd9c5b20f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:32.690325 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-68093075-fb2c-4f1f-8864-a1ccd9c5b20f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:32.690781 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-68093075-fb2c-4f1f-8864-a1ccd9c5b20f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:32.691562 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-68093075-fb2c-4f1f-8864-a1ccd9c5b20f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:32.692005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-68093075-fb2c-4f1f-8864-a1ccd9c5b20f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:32.897220 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-68093075-fb2c-4f1f-8864-a1ccd9c5b20f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:32.907349 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-68093075-fb2c-4f1f-8864-a1ccd9c5b20f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:32.908885 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-68093075-fb2c-4f1f-8864-a1ccd9c5b20f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:32.910080 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-68093075-fb2c-4f1f-8864-a1ccd9c5b20f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1724 microversion: 2.20 time: 0.231579 May 23 15:35:32.910901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 376/744] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:32 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:32.968081 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-83c05d6f-cdfd-49ff-aa6e-b915166eacab tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:32.969073 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-83c05d6f-cdfd-49ff-aa6e-b915166eacab tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:32.975632 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-83c05d6f-cdfd-49ff-aa6e-b915166eacab tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:32.976174 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-83c05d6f-cdfd-49ff-aa6e-b915166eacab tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:32.976977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-83c05d6f-cdfd-49ff-aa6e-b915166eacab tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:32.977421 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-83c05d6f-cdfd-49ff-aa6e-b915166eacab tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:33.039324 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-83c05d6f-cdfd-49ff-aa6e-b915166eacab tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:33.047183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-83c05d6f-cdfd-49ff-aa6e-b915166eacab tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 200 len: 1621 microversion: 2.1 time: 0.083778 May 23 15:35:33.047761 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 369/745] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:32 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 1621 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:33.171690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-4fedeaab-73cf-4e1f-a25d-58055e298d88 req-0a4de3d7-e1f1-471f-bc4b-d4a5e2fa96be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb26539d-bd10-48dd-9c5d-433060babfb6", "name": "network-vif-deleted", "tag": "e105091f-4632-47d3-b731-412205a70375"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:35:33.180977 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-4fedeaab-73cf-4e1f-a25d-58055e298d88 req-0a4de3d7-e1f1-471f-bc4b-d4a5e2fa96be service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:33.181591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-4fedeaab-73cf-4e1f-a25d-58055e298d88 req-0a4de3d7-e1f1-471f-bc4b-d4a5e2fa96be service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:33.193751 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-4fedeaab-73cf-4e1f-a25d-58055e298d88 req-0a4de3d7-e1f1-471f-bc4b-d4a5e2fa96be service nova] Creating event network-vif-deleted:e105091f-4632-47d3-b731-412205a70375 for instance bb26539d-bd10-48dd-9c5d-433060babfb6 on hv-cinder-84112 May 23 15:35:33.198659 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-4fedeaab-73cf-4e1f-a25d-58055e298d88 req-0a4de3d7-e1f1-471f-bc4b-d4a5e2fa96be service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030877 May 23 15:35:33.199339 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 377/746] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:35:33.929394 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-27a256a3-519f-4ba0-9c37-87cc18e79b49 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:33.929686 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-27a256a3-519f-4ba0-9c37-87cc18e79b49 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:33.935671 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-27a256a3-519f-4ba0-9c37-87cc18e79b49 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:33.936216 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-27a256a3-519f-4ba0-9c37-87cc18e79b49 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:33.937009 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-27a256a3-519f-4ba0-9c37-87cc18e79b49 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:33.937477 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-27a256a3-519f-4ba0-9c37-87cc18e79b49 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:34.071529 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ba481ac9-5abe-43dd-a098-894c313bd3e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:34.072234 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-27a256a3-519f-4ba0-9c37-87cc18e79b49 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:34.072626 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ba481ac9-5abe-43dd-a098-894c313bd3e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: bb26539d-bd10-48dd-9c5d-433060babfb6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:34.080666 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-27a256a3-519f-4ba0-9c37-87cc18e79b49 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:34.082224 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-27a256a3-519f-4ba0-9c37-87cc18e79b49 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:34.083406 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-27a256a3-519f-4ba0-9c37-87cc18e79b49 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1724 microversion: 2.20 time: 0.158411 May 23 15:35:34.083975 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 370/747] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:33 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:34.085580 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ba481ac9-5abe-43dd-a098-894c313bd3e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:34.086033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ba481ac9-5abe-43dd-a098-894c313bd3e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:34.086835 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ba481ac9-5abe-43dd-a098-894c313bd3e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:34.087348 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ba481ac9-5abe-43dd-a098-894c313bd3e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:34.101542 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-ba481ac9-5abe-43dd-a098-894c313bd3e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] HTTP exception thrown: Instance bb26539d-bd10-48dd-9c5d-433060babfb6 could not be found. May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ba481ac9-5abe-43dd-a098-894c313bd3e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Request method failure captured: May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 HTTP/1.1 May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6h-A5hbnr5tRX4j7z_Fo2SkNdX-EO3Ww9aps-yabims8fjFdE2KLn43LVxISco1aI6PJe4GKJ_4L1myusbRV8rLv7u1bxIgWrbgq5gXl0OhYXPQF8QPoudR53EbpJbeSIsHyVZJNXRpJlD2FdoebyscshU-JjudZe-a7dzSa1AlnJ8 May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 0712b807a4584f7b8f019ceb65ff1e14 May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1966403117 May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:35:34.103205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:35:34.104677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0712b807a4584f7b8f019ceb65ff1e14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0712b807a4584f7b8f019ceb65ff1e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0712b807a4584f7b8f019ceb65ff1e14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0712b807a4584f7b8f019ceb65ff1e14", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:35:34.104677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1966403117 May 23 15:35:34.104677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 0712b807a4584f7b8f019ceb65ff1e14 May 23 15:35:34.104677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1966403117 May 23 15:35:34.104677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-ServerRescueNegativeTestJSON-1966403117-project May 23 15:35:34.104677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:35:34.104677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:35:34.104677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 5074b9fa045543b9a62bf751e736d0df May 23 15:35:34.104677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1966403117-project May 23 15:35:34.104677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:35:34.104677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance bb26539d-bd10-48dd-9c5d-433060babfb6 could not be found. May 23 15:35:34.104677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': 'bb26539d-bd10-48dd-9c5d-433060babfb6'} May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb26539d-bd10-48dd-9c5d-433060babfb6 could not be found. May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:35:34.105515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb26539d-bd10-48dd-9c5d-433060babfb6 could not be found. May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb26539d-bd10-48dd-9c5d-433060babfb6 could not be found. May 23 15:35:34.106744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:34.108445 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ba481ac9-5abe-43dd-a098-894c313bd3e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Returning 404 to user: Instance bb26539d-bd10-48dd-9c5d-433060babfb6 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:35:34.108445 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ba481ac9-5abe-43dd-a098-894c313bd3e5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6" status: 404 len: 111 microversion: 2.1 time: 0.044126 May 23 15:35:34.108445 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 378/748] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:34 2022] GET /compute/v2.1/servers/bb26539d-bd10-48dd-9c5d-433060babfb6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:35:34.114214 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-0af9dc7c-3046-4a52-ada9-c2ed1fd6c5c1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '.version_select at 0x7f0d7a21d940>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:34.131806 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-0af9dc7c-3046-4a52-ada9-c2ed1fd6c5c1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-74447676" status: 202 len: 0 microversion: 2.1 time: 0.021343 May 23 15:35:34.132381 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 371/749] 10.222.0.30 () {58 vars in 1214 bytes} [Mon May 23 15:35:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-74447676 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:35:35.102927 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-735cf8cd-f845-4c9d-b0e0-8f547b263def tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:35.103552 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-735cf8cd-f845-4c9d-b0e0-8f547b263def tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:35.112153 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-735cf8cd-f845-4c9d-b0e0-8f547b263def tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:35.112628 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-735cf8cd-f845-4c9d-b0e0-8f547b263def tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:35.113406 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-735cf8cd-f845-4c9d-b0e0-8f547b263def tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:35.113874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-735cf8cd-f845-4c9d-b0e0-8f547b263def tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:35.248552 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-735cf8cd-f845-4c9d-b0e0-8f547b263def tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:35.256459 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-735cf8cd-f845-4c9d-b0e0-8f547b263def tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:35.257995 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-735cf8cd-f845-4c9d-b0e0-8f547b263def tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:35.259163 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-735cf8cd-f845-4c9d-b0e0-8f547b263def tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1724 microversion: 2.20 time: 0.161112 May 23 15:35:35.259713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 379/750] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:35 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:36.278373 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f2c61ef9-b4b3-49bb-8da1-eedaac6aefae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:36.278989 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f2c61ef9-b4b3-49bb-8da1-eedaac6aefae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:36.285579 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f2c61ef9-b4b3-49bb-8da1-eedaac6aefae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:36.286031 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f2c61ef9-b4b3-49bb-8da1-eedaac6aefae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:36.286800 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f2c61ef9-b4b3-49bb-8da1-eedaac6aefae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:36.287240 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f2c61ef9-b4b3-49bb-8da1-eedaac6aefae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:36.302656 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:36.418057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f2c61ef9-b4b3-49bb-8da1-eedaac6aefae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:36.426835 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f2c61ef9-b4b3-49bb-8da1-eedaac6aefae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:36.428345 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f2c61ef9-b4b3-49bb-8da1-eedaac6aefae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:36.429548 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f2c61ef9-b4b3-49bb-8da1-eedaac6aefae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1724 microversion: 2.20 time: 0.155704 May 23 15:35:36.430102 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 372/751] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:36 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:37.005421 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-da14f9f8-fe1d-4a30-8dcf-39721da7b487 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:37.005929 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-da14f9f8-fe1d-4a30-8dcf-39721da7b487 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:37.012481 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-da14f9f8-fe1d-4a30-8dcf-39721da7b487 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:37.012974 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-da14f9f8-fe1d-4a30-8dcf-39721da7b487 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:37.013743 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-da14f9f8-fe1d-4a30-8dcf-39721da7b487 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:37.014185 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-da14f9f8-fe1d-4a30-8dcf-39721da7b487 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:37.039326 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-da14f9f8-fe1d-4a30-8dcf-39721da7b487 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Going to try to terminate instance {{(pid=117974) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:35:37.114012 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-da14f9f8-fe1d-4a30-8dcf-39721da7b487 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 204 len: 0 microversion: 2.1 time: 0.112055 May 23 15:35:37.114752 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 380/752] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:35:37 2022] DELETE /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:35:37.122699 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c43ac80c-393c-4aac-8340-02b80725d22b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:37.123320 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c43ac80c-393c-4aac-8340-02b80725d22b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:37.129825 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c43ac80c-393c-4aac-8340-02b80725d22b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:37.130282 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c43ac80c-393c-4aac-8340-02b80725d22b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:37.131060 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c43ac80c-393c-4aac-8340-02b80725d22b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:37.131502 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c43ac80c-393c-4aac-8340-02b80725d22b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:37.258341 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c43ac80c-393c-4aac-8340-02b80725d22b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:37.267644 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c43ac80c-393c-4aac-8340-02b80725d22b tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1507 microversion: 2.1 time: 0.148716 May 23 15:35:37.268224 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 373/753] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:37 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:37.449209 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d2664641-131f-461f-b71b-56e4bb35da64 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:37.450079 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d2664641-131f-461f-b71b-56e4bb35da64 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:37.456347 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d2664641-131f-461f-b71b-56e4bb35da64 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:37.456800 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d2664641-131f-461f-b71b-56e4bb35da64 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:37.457660 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d2664641-131f-461f-b71b-56e4bb35da64 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:37.458055 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d2664641-131f-461f-b71b-56e4bb35da64 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:37.590131 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d2664641-131f-461f-b71b-56e4bb35da64 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:37.598626 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d2664641-131f-461f-b71b-56e4bb35da64 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:37.600146 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d2664641-131f-461f-b71b-56e4bb35da64 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:37.601349 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d2664641-131f-461f-b71b-56e4bb35da64 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1724 microversion: 2.20 time: 0.157128 May 23 15:35:37.601905 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 381/754] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:37 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:38.285547 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-06c04832-468d-455e-8a41-bafaca8c418f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:38.286166 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-06c04832-468d-455e-8a41-bafaca8c418f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:38.292787 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-06c04832-468d-455e-8a41-bafaca8c418f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:38.293210 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-06c04832-468d-455e-8a41-bafaca8c418f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:38.293979 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-06c04832-468d-455e-8a41-bafaca8c418f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:38.294419 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-06c04832-468d-455e-8a41-bafaca8c418f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:38.427956 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-06c04832-468d-455e-8a41-bafaca8c418f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:38.435494 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-06c04832-468d-455e-8a41-bafaca8c418f tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1507 microversion: 2.1 time: 0.154368 May 23 15:35:38.436816 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 374/755] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:38 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:38.619548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c815271d-7bd5-493d-8bb6-1d2ae9b669cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:38.620165 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-c815271d-7bd5-493d-8bb6-1d2ae9b669cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:38.626944 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c815271d-7bd5-493d-8bb6-1d2ae9b669cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:38.627395 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c815271d-7bd5-493d-8bb6-1d2ae9b669cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:38.628160 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c815271d-7bd5-493d-8bb6-1d2ae9b669cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:38.628598 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c815271d-7bd5-493d-8bb6-1d2ae9b669cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:38.758373 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c815271d-7bd5-493d-8bb6-1d2ae9b669cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:38.766824 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c815271d-7bd5-493d-8bb6-1d2ae9b669cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:38.768333 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c815271d-7bd5-493d-8bb6-1d2ae9b669cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:38.769536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-c815271d-7bd5-493d-8bb6-1d2ae9b669cc tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1724 microversion: 2.20 time: 0.153923 May 23 15:35:38.770094 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 382/756] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:38 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:39.455310 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-e382d1a2-830a-400c-bca5-b3d31a4e1242 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:39.455942 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-e382d1a2-830a-400c-bca5-b3d31a4e1242 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:39.462541 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e382d1a2-830a-400c-bca5-b3d31a4e1242 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:39.463003 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e382d1a2-830a-400c-bca5-b3d31a4e1242 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:39.463793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e382d1a2-830a-400c-bca5-b3d31a4e1242 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:39.465139 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e382d1a2-830a-400c-bca5-b3d31a4e1242 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:39.537224 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-634eb6a5-8da8-4a7e-8934-2ff9a755b551 req-2edc13ad-1ff1-4268-b957-421fdb009ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b766d9-7a6b-4d3a-8144-f23605dee4f9", "name": "network-vif-deleted", "tag": "7a7ef05a-a7c7-40c6-8f33-1c4a2609e20c"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:35:39.546763 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-e382d1a2-830a-400c-bca5-b3d31a4e1242 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:39.549962 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-634eb6a5-8da8-4a7e-8934-2ff9a755b551 req-2edc13ad-1ff1-4268-b957-421fdb009ca6 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:39.550084 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-634eb6a5-8da8-4a7e-8934-2ff9a755b551 req-2edc13ad-1ff1-4268-b957-421fdb009ca6 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:39.556155 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-e382d1a2-830a-400c-bca5-b3d31a4e1242 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 200 len: 1465 microversion: 2.1 time: 0.105837 May 23 15:35:39.557083 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 375/757] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:39 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 1465 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:39.561845 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-634eb6a5-8da8-4a7e-8934-2ff9a755b551 req-2edc13ad-1ff1-4268-b957-421fdb009ca6 service nova] Creating event network-vif-deleted:7a7ef05a-a7c7-40c6-8f33-1c4a2609e20c for instance c7b766d9-7a6b-4d3a-8144-f23605dee4f9 on hv-cinder-84112 May 23 15:35:39.568220 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-634eb6a5-8da8-4a7e-8934-2ff9a755b551 req-2edc13ad-1ff1-4268-b957-421fdb009ca6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034492 May 23 15:35:39.568833 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 383/758] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:35:39.787464 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-91fa6cec-4c9b-494f-afc9-daae91ce7783 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:39.788113 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-91fa6cec-4c9b-494f-afc9-daae91ce7783 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:39.794193 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-91fa6cec-4c9b-494f-afc9-daae91ce7783 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:39.794654 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-91fa6cec-4c9b-494f-afc9-daae91ce7783 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:39.796062 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-91fa6cec-4c9b-494f-afc9-daae91ce7783 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:39.796554 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-91fa6cec-4c9b-494f-afc9-daae91ce7783 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:39.931342 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-91fa6cec-4c9b-494f-afc9-daae91ce7783 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:39.940427 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-91fa6cec-4c9b-494f-afc9-daae91ce7783 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:39.941975 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-91fa6cec-4c9b-494f-afc9-daae91ce7783 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:39.943216 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-91fa6cec-4c9b-494f-afc9-daae91ce7783 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1724 microversion: 2.20 time: 0.159621 May 23 15:35:39.943787 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 376/759] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:39 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:40.575172 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-de9a0c9e-bbc6-4a5e-8d83-3de158b262ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:40.576006 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-de9a0c9e-bbc6-4a5e-8d83-3de158b262ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: c7b766d9-7a6b-4d3a-8144-f23605dee4f9] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:40.583532 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-de9a0c9e-bbc6-4a5e-8d83-3de158b262ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:40.584023 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-de9a0c9e-bbc6-4a5e-8d83-3de158b262ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:40.584796 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-de9a0c9e-bbc6-4a5e-8d83-3de158b262ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:40.585283 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-de9a0c9e-bbc6-4a5e-8d83-3de158b262ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:40.599983 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-de9a0c9e-bbc6-4a5e-8d83-3de158b262ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] HTTP exception thrown: Instance c7b766d9-7a6b-4d3a-8144-f23605dee4f9 could not be found. May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-de9a0c9e-bbc6-4a5e-8d83-3de158b262ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Request method failure captured: May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 HTTP/1.1 May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6h-A5hbnr5tRX4j7z_Fo2SkNdX-EO3Ww9aps-yabims8fjFdE2KLn43LVxISco1aI6PJe4GKJ_4L1myusbRV8rLv7u1bxIgWrbgq5gXl0OhYXPQF8QPoudR53EbpJbeSIsHyVZJNXRpJlD2FdoebyscshU-JjudZe-a7dzSa1AlnJ8 May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 0712b807a4584f7b8f019ceb65ff1e14 May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1966403117 May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:35:40.601679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:35:40.603667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0712b807a4584f7b8f019ceb65ff1e14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0712b807a4584f7b8f019ceb65ff1e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0712b807a4584f7b8f019ceb65ff1e14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0712b807a4584f7b8f019ceb65ff1e14", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:35:40.603667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1966403117 May 23 15:35:40.603667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 0712b807a4584f7b8f019ceb65ff1e14 May 23 15:35:40.603667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1966403117 May 23 15:35:40.603667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-ServerRescueNegativeTestJSON-1966403117-project May 23 15:35:40.603667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:35:40.603667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:35:40.603667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 5074b9fa045543b9a62bf751e736d0df May 23 15:35:40.603667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1966403117-project May 23 15:35:40.603667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:35:40.603667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance c7b766d9-7a6b-4d3a-8144-f23605dee4f9 could not be found. May 23 15:35:40.603667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': 'c7b766d9-7a6b-4d3a-8144-f23605dee4f9'} May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b766d9-7a6b-4d3a-8144-f23605dee4f9 could not be found. May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:35:40.604839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b766d9-7a6b-4d3a-8144-f23605dee4f9 could not be found. May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b766d9-7a6b-4d3a-8144-f23605dee4f9 could not be found. May 23 15:35:40.606267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:40.608153 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-de9a0c9e-bbc6-4a5e-8d83-3de158b262ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Returning 404 to user: Instance c7b766d9-7a6b-4d3a-8144-f23605dee4f9 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:35:40.608153 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-de9a0c9e-bbc6-4a5e-8d83-3de158b262ce tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9" status: 404 len: 111 microversion: 2.1 time: 0.033105 May 23 15:35:40.608153 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 384/760] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:40 2022] GET /compute/v2.1/servers/c7b766d9-7a6b-4d3a-8144-f23605dee4f9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:35:40.612009 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5e19fa3a-6253-42ff-8a10-988620688c5c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:40.612513 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-5e19fa3a-6253-42ff-8a10-988620688c5c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:40.618989 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5e19fa3a-6253-42ff-8a10-988620688c5c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:40.619450 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5e19fa3a-6253-42ff-8a10-988620688c5c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:40.620222 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5e19fa3a-6253-42ff-8a10-988620688c5c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:40.620666 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5e19fa3a-6253-42ff-8a10-988620688c5c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:40.645595 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-5e19fa3a-6253-42ff-8a10-988620688c5c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Going to try to terminate instance {{(pid=117973) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:35:40.720052 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-5e19fa3a-6253-42ff-8a10-988620688c5c tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "DELETE /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 204 len: 0 microversion: 2.1 time: 0.111450 May 23 15:35:40.720738 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 377/761] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:35:40 2022] DELETE /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:35:40.731506 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8700b9a7-bb95-4b9b-aae3-ceb0faaa2ec0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:40.732567 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8700b9a7-bb95-4b9b-aae3-ceb0faaa2ec0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:40.738687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8700b9a7-bb95-4b9b-aae3-ceb0faaa2ec0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:40.739142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8700b9a7-bb95-4b9b-aae3-ceb0faaa2ec0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:40.739939 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8700b9a7-bb95-4b9b-aae3-ceb0faaa2ec0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:40.740380 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8700b9a7-bb95-4b9b-aae3-ceb0faaa2ec0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:40.880581 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-8700b9a7-bb95-4b9b-aae3-ceb0faaa2ec0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:40.888307 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8700b9a7-bb95-4b9b-aae3-ceb0faaa2ec0 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.162890 May 23 15:35:40.888910 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 385/762] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:40 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:40.961858 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-71ae9216-035a-4cef-b3d1-769183ac5a78 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:40.962560 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-71ae9216-035a-4cef-b3d1-769183ac5a78 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:40.968431 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-71ae9216-035a-4cef-b3d1-769183ac5a78 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:40.968893 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-71ae9216-035a-4cef-b3d1-769183ac5a78 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:40.969699 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-71ae9216-035a-4cef-b3d1-769183ac5a78 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:40.970137 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-71ae9216-035a-4cef-b3d1-769183ac5a78 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:41.102376 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-71ae9216-035a-4cef-b3d1-769183ac5a78 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:41.110887 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-71ae9216-035a-4cef-b3d1-769183ac5a78 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:41.112389 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-71ae9216-035a-4cef-b3d1-769183ac5a78 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:41.113585 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-71ae9216-035a-4cef-b3d1-769183ac5a78 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1745 microversion: 2.20 time: 0.155983 May 23 15:35:41.114149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 378/763] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:40 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:41.907697 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3024b488-94c8-4630-bf22-2776a41076a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:41.908336 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3024b488-94c8-4630-bf22-2776a41076a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:41.915629 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3024b488-94c8-4630-bf22-2776a41076a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:41.916087 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3024b488-94c8-4630-bf22-2776a41076a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:41.916858 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3024b488-94c8-4630-bf22-2776a41076a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:41.917322 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3024b488-94c8-4630-bf22-2776a41076a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:42.046786 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3024b488-94c8-4630-bf22-2776a41076a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:42.054525 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3024b488-94c8-4630-bf22-2776a41076a1 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.151840 May 23 15:35:42.055094 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 386/764] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:41 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:42.132293 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8e51dc21-6749-40ff-b580-439d27dbc4f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:42.133158 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8e51dc21-6749-40ff-b580-439d27dbc4f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:42.141874 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8e51dc21-6749-40ff-b580-439d27dbc4f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:42.142406 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8e51dc21-6749-40ff-b580-439d27dbc4f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:42.143515 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8e51dc21-6749-40ff-b580-439d27dbc4f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:42.143965 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8e51dc21-6749-40ff-b580-439d27dbc4f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:42.272659 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8e51dc21-6749-40ff-b580-439d27dbc4f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:42.280498 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8e51dc21-6749-40ff-b580-439d27dbc4f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:42.282063 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8e51dc21-6749-40ff-b580-439d27dbc4f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:42.283224 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8e51dc21-6749-40ff-b580-439d27dbc4f0 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1745 microversion: 2.20 time: 0.155607 May 23 15:35:42.283788 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 379/765] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:42 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:43.071567 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ba3d1e0b-6fdc-42a4-9d72-b91659e06bf8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:43.072210 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ba3d1e0b-6fdc-42a4-9d72-b91659e06bf8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:43.074633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:43.079990 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ba3d1e0b-6fdc-42a4-9d72-b91659e06bf8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:43.080439 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ba3d1e0b-6fdc-42a4-9d72-b91659e06bf8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:43.081244 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ba3d1e0b-6fdc-42a4-9d72-b91659e06bf8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:43.081681 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ba3d1e0b-6fdc-42a4-9d72-b91659e06bf8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:43.214623 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ba3d1e0b-6fdc-42a4-9d72-b91659e06bf8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:43.222718 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ba3d1e0b-6fdc-42a4-9d72-b91659e06bf8 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1523 microversion: 2.1 time: 0.155032 May 23 15:35:43.223305 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 387/766] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:43 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:43.302235 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-9c62e005-fe78-4b04-b5db-da61a3724d51 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:43.302853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-9c62e005-fe78-4b04-b5db-da61a3724d51 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:43.309349 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9c62e005-fe78-4b04-b5db-da61a3724d51 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:43.309805 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9c62e005-fe78-4b04-b5db-da61a3724d51 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:43.310571 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9c62e005-fe78-4b04-b5db-da61a3724d51 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:43.311016 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9c62e005-fe78-4b04-b5db-da61a3724d51 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:43.440649 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9c62e005-fe78-4b04-b5db-da61a3724d51 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:43.450669 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9c62e005-fe78-4b04-b5db-da61a3724d51 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:43.452628 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9c62e005-fe78-4b04-b5db-da61a3724d51 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:43.454796 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-9c62e005-fe78-4b04-b5db-da61a3724d51 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1745 microversion: 2.20 time: 0.156240 May 23 15:35:43.455504 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 380/767] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:43 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:44.206366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-063377d7-c55b-46b6-9003-22e6c6bc10d8 req-b8944d17-a30a-4c3a-9a05-330cd90521df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5c3bd6-1b7d-4c25-a705-2291f6709285", "name": "network-vif-plugged", "status": "completed", "tag": "1163c3a8-18a2-4093-9e90-731d856e8076"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:35:44.215727 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-063377d7-c55b-46b6-9003-22e6c6bc10d8 req-b8944d17-a30a-4c3a-9a05-330cd90521df service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:44.216495 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-063377d7-c55b-46b6-9003-22e6c6bc10d8 req-b8944d17-a30a-4c3a-9a05-330cd90521df service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:44.228265 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-93cb50c0-fa0d-4f24-95de-4b5e1c04f681 req-6f5efccc-0568-49cb-a6d3-2a7a3a5fe3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f940d7-a17e-4271-9326-70a868f80e59", "name": "network-vif-deleted", "tag": "2e43ebd5-c351-461f-b27d-7ba1cfcd864a"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:35:44.233621 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-063377d7-c55b-46b6-9003-22e6c6bc10d8 req-b8944d17-a30a-4c3a-9a05-330cd90521df service nova] Creating event network-vif-plugged:1163c3a8-18a2-4093-9e90-731d856e8076 for instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 on hv-cinder-84112 May 23 15:35:44.239504 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-063377d7-c55b-46b6-9003-22e6c6bc10d8 req-b8944d17-a30a-4c3a-9a05-330cd90521df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130838 May 23 15:35:44.240093 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 388/768] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:35:44.242403 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-93cb50c0-fa0d-4f24-95de-4b5e1c04f681 req-6f5efccc-0568-49cb-a6d3-2a7a3a5fe3c3 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:44.243540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-93cb50c0-fa0d-4f24-95de-4b5e1c04f681 req-6f5efccc-0568-49cb-a6d3-2a7a3a5fe3c3 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:44.265567 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e01fec2a-1daa-41c4-8ea9-f7095915f285 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:44.267884 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e01fec2a-1daa-41c4-8ea9-f7095915f285 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:44.270196 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-93cb50c0-fa0d-4f24-95de-4b5e1c04f681 req-6f5efccc-0568-49cb-a6d3-2a7a3a5fe3c3 service nova] Creating event network-vif-deleted:2e43ebd5-c351-461f-b27d-7ba1cfcd864a for instance 40f940d7-a17e-4271-9326-70a868f80e59 on hv-cinder-84112 May 23 15:35:44.278665 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e01fec2a-1daa-41c4-8ea9-f7095915f285 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:44.279854 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-93cb50c0-fa0d-4f24-95de-4b5e1c04f681 req-6f5efccc-0568-49cb-a6d3-2a7a3a5fe3c3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054979 May 23 15:35:44.280546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 381/769] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:35:44.280970 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e01fec2a-1daa-41c4-8ea9-f7095915f285 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:44.282181 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e01fec2a-1daa-41c4-8ea9-f7095915f285 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:44.282804 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e01fec2a-1daa-41c4-8ea9-f7095915f285 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:44.371760 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e01fec2a-1daa-41c4-8ea9-f7095915f285 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074b9fa045543b9a62bf751e736d0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0712b807a4584f7b8f019ceb65ff1e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:44.380270 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e01fec2a-1daa-41c4-8ea9-f7095915f285 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 200 len: 1307 microversion: 2.1 time: 0.130014 May 23 15:35:44.381313 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 389/770] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:44 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 1307 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:44.475702 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5263dbdd-a7d7-405e-8687-1a1aa1607f3a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:44.476571 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-5263dbdd-a7d7-405e-8687-1a1aa1607f3a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:44.482882 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5263dbdd-a7d7-405e-8687-1a1aa1607f3a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:44.483406 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5263dbdd-a7d7-405e-8687-1a1aa1607f3a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:44.484278 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5263dbdd-a7d7-405e-8687-1a1aa1607f3a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:44.485489 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5263dbdd-a7d7-405e-8687-1a1aa1607f3a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:44.641977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-5263dbdd-a7d7-405e-8687-1a1aa1607f3a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:44.651922 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-5263dbdd-a7d7-405e-8687-1a1aa1607f3a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:44.654199 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-5263dbdd-a7d7-405e-8687-1a1aa1607f3a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:44.656522 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-5263dbdd-a7d7-405e-8687-1a1aa1607f3a tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1740 microversion: 2.20 time: 0.185276 May 23 15:35:44.660605 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 382/771] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:44 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:45.398495 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2335b81d-5d04-4548-b7d4-e3ed3e0b04c5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:45.399207 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-2335b81d-5d04-4548-b7d4-e3ed3e0b04c5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] [instance: 40f940d7-a17e-4271-9326-70a868f80e59] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:45.405786 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2335b81d-5d04-4548-b7d4-e3ed3e0b04c5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:45.406343 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2335b81d-5d04-4548-b7d4-e3ed3e0b04c5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:45.407707 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2335b81d-5d04-4548-b7d4-e3ed3e0b04c5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:45.408394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2335b81d-5d04-4548-b7d4-e3ed3e0b04c5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:45.423754 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-2335b81d-5d04-4548-b7d4-e3ed3e0b04c5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] HTTP exception thrown: Instance 40f940d7-a17e-4271-9326-70a868f80e59 could not be found. May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2335b81d-5d04-4548-b7d4-e3ed3e0b04c5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Request method failure captured: May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 HTTP/1.1 May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6h-A5hbnr5tRX4j7z_Fo2SkNdX-EO3Ww9aps-yabims8fjFdE2KLn43LVxISco1aI6PJe4GKJ_4L1myusbRV8rLv7u1bxIgWrbgq5gXl0OhYXPQF8QPoudR53EbpJbeSIsHyVZJNXRpJlD2FdoebyscshU-JjudZe-a7dzSa1AlnJ8 May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 0712b807a4584f7b8f019ceb65ff1e14 May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1966403117 May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:35:45.425486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:35:45.427088 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0712b807a4584f7b8f019ceb65ff1e14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0712b807a4584f7b8f019ceb65ff1e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0712b807a4584f7b8f019ceb65ff1e14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0712b807a4584f7b8f019ceb65ff1e14", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:35:45.427088 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1966403117 May 23 15:35:45.427088 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 0712b807a4584f7b8f019ceb65ff1e14 May 23 15:35:45.427088 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1966403117 May 23 15:35:45.427088 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-ServerRescueNegativeTestJSON-1966403117-project May 23 15:35:45.427088 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:35:45.427088 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:35:45.427088 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 5074b9fa045543b9a62bf751e736d0df May 23 15:35:45.427088 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1966403117-project May 23 15:35:45.427088 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:35:45.427088 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance 40f940d7-a17e-4271-9326-70a868f80e59 could not be found. May 23 15:35:45.427088 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '40f940d7-a17e-4271-9326-70a868f80e59'} May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40f940d7-a17e-4271-9326-70a868f80e59 could not be found. May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:35:45.428039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40f940d7-a17e-4271-9326-70a868f80e59 could not be found. May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40f940d7-a17e-4271-9326-70a868f80e59 could not be found. May 23 15:35:45.429625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:35:45.431065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2335b81d-5d04-4548-b7d4-e3ed3e0b04c5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] Returning 404 to user: Instance 40f940d7-a17e-4271-9326-70a868f80e59 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:35:45.431065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-2335b81d-5d04-4548-b7d4-e3ed3e0b04c5 tempest-ServerRescueNegativeTestJSON-1966403117 tempest-ServerRescueNegativeTestJSON-1966403117-project] 10.222.0.30 "GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59" status: 404 len: 111 microversion: 2.1 time: 0.032499 May 23 15:35:45.431065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 390/772] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:35:45 2022] GET /compute/v2.1/servers/40f940d7-a17e-4271-9326-70a868f80e59 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:35:45.678199 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-cc35bb95-d488-41af-bc3f-b0da2b252859 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:45.678737 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-cc35bb95-d488-41af-bc3f-b0da2b252859 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:45.686167 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cc35bb95-d488-41af-bc3f-b0da2b252859 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:45.686898 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cc35bb95-d488-41af-bc3f-b0da2b252859 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:45.687867 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cc35bb95-d488-41af-bc3f-b0da2b252859 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:45.688332 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cc35bb95-d488-41af-bc3f-b0da2b252859 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:45.950282 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-cc35bb95-d488-41af-bc3f-b0da2b252859 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:45.962693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-cc35bb95-d488-41af-bc3f-b0da2b252859 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:45.965345 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-cc35bb95-d488-41af-bc3f-b0da2b252859 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:45.967811 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-cc35bb95-d488-41af-bc3f-b0da2b252859 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1740 microversion: 2.20 time: 0.293248 May 23 15:35:45.979449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 383/773] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:45 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1740 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:46.988808 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-43dcd87a-a50b-4d95-9b1b-ccb7e1fc080c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:46.990328 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-43dcd87a-a50b-4d95-9b1b-ccb7e1fc080c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:46.998487 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-43dcd87a-a50b-4d95-9b1b-ccb7e1fc080c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:46.999294 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-43dcd87a-a50b-4d95-9b1b-ccb7e1fc080c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:47.004011 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-43dcd87a-a50b-4d95-9b1b-ccb7e1fc080c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:47.004900 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-43dcd87a-a50b-4d95-9b1b-ccb7e1fc080c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:47.179114 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-43dcd87a-a50b-4d95-9b1b-ccb7e1fc080c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:47.187364 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-43dcd87a-a50b-4d95-9b1b-ccb7e1fc080c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:47.192070 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-43dcd87a-a50b-4d95-9b1b-ccb7e1fc080c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:47.194649 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-43dcd87a-a50b-4d95-9b1b-ccb7e1fc080c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1740 microversion: 2.20 time: 0.212174 May 23 15:35:47.195370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 391/774] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:46 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:48.213531 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f4d874c7-54ff-47ec-a3ab-018c41346fc9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:48.214801 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f4d874c7-54ff-47ec-a3ab-018c41346fc9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:48.224175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f4d874c7-54ff-47ec-a3ab-018c41346fc9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:48.224916 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f4d874c7-54ff-47ec-a3ab-018c41346fc9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:48.225882 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f4d874c7-54ff-47ec-a3ab-018c41346fc9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:48.226479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f4d874c7-54ff-47ec-a3ab-018c41346fc9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:48.515568 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f4d874c7-54ff-47ec-a3ab-018c41346fc9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:48.523979 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f4d874c7-54ff-47ec-a3ab-018c41346fc9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:48.525814 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f4d874c7-54ff-47ec-a3ab-018c41346fc9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:48.527213 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f4d874c7-54ff-47ec-a3ab-018c41346fc9 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1740 microversion: 2.20 time: 0.317521 May 23 15:35:48.539245 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 384/775] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:48 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1740 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:49.546995 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-7430e478-c436-43db-aed4-ea5bd78f676f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:49.550627 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-7430e478-c436-43db-aed4-ea5bd78f676f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:49.562932 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7430e478-c436-43db-aed4-ea5bd78f676f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:49.564768 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7430e478-c436-43db-aed4-ea5bd78f676f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:49.568039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7430e478-c436-43db-aed4-ea5bd78f676f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:49.568758 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7430e478-c436-43db-aed4-ea5bd78f676f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:49.818107 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-7430e478-c436-43db-aed4-ea5bd78f676f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:49.822002 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:49.838383 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-7430e478-c436-43db-aed4-ea5bd78f676f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:49.845469 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-7430e478-c436-43db-aed4-ea5bd78f676f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:49.847199 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-7430e478-c436-43db-aed4-ea5bd78f676f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1740 microversion: 2.20 time: 0.304817 May 23 15:35:49.848150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 392/776] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:49 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1740 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:35:50.869155 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-038d4dee-602c-4532-9fca-ca38da8c8b28 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:50.869744 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-038d4dee-602c-4532-9fca-ca38da8c8b28 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:50.879816 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-038d4dee-602c-4532-9fca-ca38da8c8b28 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:50.880264 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-038d4dee-602c-4532-9fca-ca38da8c8b28 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:50.881092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-038d4dee-602c-4532-9fca-ca38da8c8b28 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:50.881523 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-038d4dee-602c-4532-9fca-ca38da8c8b28 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:51.075709 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-038d4dee-602c-4532-9fca-ca38da8c8b28 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:51.088657 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-038d4dee-602c-4532-9fca-ca38da8c8b28 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:51.091680 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-038d4dee-602c-4532-9fca-ca38da8c8b28 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:51.092897 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-038d4dee-602c-4532-9fca-ca38da8c8b28 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1740 microversion: 2.20 time: 0.227852 May 23 15:35:51.093457 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 385/777] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:50 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:51.815698 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-33a0dba6-1549-4639-8cf4-4680223d7b39 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:51.817337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-33a0dba6-1549-4639-8cf4-4680223d7b39 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:51.832504 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-33a0dba6-1549-4639-8cf4-4680223d7b39 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:51.835252 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-33a0dba6-1549-4639-8cf4-4680223d7b39 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:51.837548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-33a0dba6-1549-4639-8cf4-4680223d7b39 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:51.840392 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-33a0dba6-1549-4639-8cf4-4680223d7b39 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:51.875243 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-33a0dba6-1549-4639-8cf4-4680223d7b39 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/ips" status: 200 len: 144 microversion: 2.1 time: 0.336438 May 23 15:35:51.881451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 393/778] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 15:35:51 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/ips => generated 144 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:35:52.113411 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-bc20239a-1b07-4476-b638-e0aa7f1a9308 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:52.115076 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-bc20239a-1b07-4476-b638-e0aa7f1a9308 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:52.127567 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bc20239a-1b07-4476-b638-e0aa7f1a9308 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:52.132098 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bc20239a-1b07-4476-b638-e0aa7f1a9308 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:52.137215 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bc20239a-1b07-4476-b638-e0aa7f1a9308 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:52.138092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bc20239a-1b07-4476-b638-e0aa7f1a9308 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:52.406616 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-bc20239a-1b07-4476-b638-e0aa7f1a9308 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:52.417620 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-bc20239a-1b07-4476-b638-e0aa7f1a9308 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:52.419264 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-bc20239a-1b07-4476-b638-e0aa7f1a9308 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:52.420557 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-bc20239a-1b07-4476-b638-e0aa7f1a9308 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1740 microversion: 2.20 time: 0.313488 May 23 15:35:52.421523 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 386/779] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:52 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1740 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:53.440713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3e995d60-4e85-47fa-bba0-b4befc536b79 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:53.441441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3e995d60-4e85-47fa-bba0-b4befc536b79 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:53.456937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3e995d60-4e85-47fa-bba0-b4befc536b79 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:53.457394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3e995d60-4e85-47fa-bba0-b4befc536b79 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:53.461464 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3e995d60-4e85-47fa-bba0-b4befc536b79 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:53.462153 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3e995d60-4e85-47fa-bba0-b4befc536b79 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:53.481259 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-89136bf9-50ff-47f3-9a9a-51f1b773a460 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "908af409-ec42-4911-95a8-26548ad628e5"}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:35:53.483525 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-89136bf9-50ff-47f3-9a9a-51f1b773a460 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:53.491718 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-89136bf9-50ff-47f3-9a9a-51f1b773a460 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:53.492854 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-89136bf9-50ff-47f3-9a9a-51f1b773a460 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:53.493989 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-89136bf9-50ff-47f3-9a9a-51f1b773a460 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:53.494598 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-89136bf9-50ff-47f3-9a9a-51f1b773a460 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:53.693098 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:53.813909 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3e995d60-4e85-47fa-bba0-b4befc536b79 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:53.827050 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3e995d60-4e85-47fa-bba0-b4befc536b79 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:53.830844 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3e995d60-4e85-47fa-bba0-b4befc536b79 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:53.833172 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3e995d60-4e85-47fa-bba0-b4befc536b79 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1740 microversion: 2.20 time: 0.397353 May 23 15:35:53.844105 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 394/780] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:53 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1740 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:53.939106 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-89136bf9-50ff-47f3-9a9a-51f1b773a460 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "POST /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.460651 May 23 15:35:53.955436 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 387/781] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 15:35:53 2022] POST /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments => generated 194 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:35:54.851850 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-40d48680-636e-4818-a489-ea3acf68873c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:54.852486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-40d48680-636e-4818-a489-ea3acf68873c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:54.861793 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-40d48680-636e-4818-a489-ea3acf68873c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:54.862457 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-40d48680-636e-4818-a489-ea3acf68873c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:54.863343 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-40d48680-636e-4818-a489-ea3acf68873c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:54.863828 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-40d48680-636e-4818-a489-ea3acf68873c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:55.020642 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-40d48680-636e-4818-a489-ea3acf68873c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:55.030187 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-40d48680-636e-4818-a489-ea3acf68873c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:55.032429 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-40d48680-636e-4818-a489-ea3acf68873c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:55.033971 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-40d48680-636e-4818-a489-ea3acf68873c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1740 microversion: 2.20 time: 0.186186 May 23 15:35:55.034945 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 395/782] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:54 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:56.054391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5895de7f-a59b-466e-96cf-86ea6d4444d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:56.055878 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-5895de7f-a59b-466e-96cf-86ea6d4444d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:56.063049 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5895de7f-a59b-466e-96cf-86ea6d4444d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:56.063619 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5895de7f-a59b-466e-96cf-86ea6d4444d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:56.064517 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5895de7f-a59b-466e-96cf-86ea6d4444d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:56.065225 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5895de7f-a59b-466e-96cf-86ea6d4444d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:56.238047 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-5895de7f-a59b-466e-96cf-86ea6d4444d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:56.246483 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-5895de7f-a59b-466e-96cf-86ea6d4444d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:56.248024 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-5895de7f-a59b-466e-96cf-86ea6d4444d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:56.249229 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-5895de7f-a59b-466e-96cf-86ea6d4444d7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1722 microversion: 2.20 time: 0.200107 May 23 15:35:56.249777 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 388/783] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:56 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:57.267679 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-20e2e0e1-ded9-4404-ba37-ef670e48dcd6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:57.268305 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-20e2e0e1-ded9-4404-ba37-ef670e48dcd6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:57.275498 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-20e2e0e1-ded9-4404-ba37-ef670e48dcd6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:57.275950 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-20e2e0e1-ded9-4404-ba37-ef670e48dcd6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:57.276727 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-20e2e0e1-ded9-4404-ba37-ef670e48dcd6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:57.277188 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-20e2e0e1-ded9-4404-ba37-ef670e48dcd6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:57.413164 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-20e2e0e1-ded9-4404-ba37-ef670e48dcd6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:57.421355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-20e2e0e1-ded9-4404-ba37-ef670e48dcd6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:57.423510 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-20e2e0e1-ded9-4404-ba37-ef670e48dcd6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:57.425059 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-20e2e0e1-ded9-4404-ba37-ef670e48dcd6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1722 microversion: 2.20 time: 0.161421 May 23 15:35:57.425619 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 396/784] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:57 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:58.443990 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1b719425-4cc1-4302-81ce-64294bc2c798 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:58.444722 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-1b719425-4cc1-4302-81ce-64294bc2c798 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:58.447353 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:58.453212 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1b719425-4cc1-4302-81ce-64294bc2c798 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:58.454275 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1b719425-4cc1-4302-81ce-64294bc2c798 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:58.455455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1b719425-4cc1-4302-81ce-64294bc2c798 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:58.455960 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1b719425-4cc1-4302-81ce-64294bc2c798 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:58.607280 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-1b719425-4cc1-4302-81ce-64294bc2c798 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:58.616463 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-1b719425-4cc1-4302-81ce-64294bc2c798 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:58.618023 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-1b719425-4cc1-4302-81ce-64294bc2c798 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:58.619196 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1b719425-4cc1-4302-81ce-64294bc2c798 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1725 microversion: 2.20 time: 0.179296 May 23 15:35:58.619766 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 389/785] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:58 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:58.637140 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b57bab38-aa29-473a-878f-329722e37d70 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c2b503c-2ffa-46a7-a480-78d336690b29"}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:35:58.638242 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b57bab38-aa29-473a-878f-329722e37d70 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:58.644942 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b57bab38-aa29-473a-878f-329722e37d70 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:58.645390 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b57bab38-aa29-473a-878f-329722e37d70 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:58.646144 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b57bab38-aa29-473a-878f-329722e37d70 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:58.646573 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b57bab38-aa29-473a-878f-329722e37d70 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:58.942483 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b57bab38-aa29-473a-878f-329722e37d70 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "POST /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.309262 May 23 15:35:58.943131 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 397/786] 10.222.0.30 () {62 vars in 1363 bytes} [Mon May 23 15:35:58 2022] POST /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285/os-volume_attachments => generated 188 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:35:59.062468 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-58223265-a8a2-4d01-ad5f-e0d197865931 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:59.062961 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-58223265-a8a2-4d01-ad5f-e0d197865931 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:59.070586 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58223265-a8a2-4d01-ad5f-e0d197865931 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:59.071159 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58223265-a8a2-4d01-ad5f-e0d197865931 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:59.072135 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58223265-a8a2-4d01-ad5f-e0d197865931 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:59.072632 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58223265-a8a2-4d01-ad5f-e0d197865931 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:59.513156 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-58223265-a8a2-4d01-ad5f-e0d197865931 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285/os-volume_attachments/8c2b503c-2ffa-46a7-a480-78d336690b29" status: 202 len: 0 microversion: 2.20 time: 0.454443 May 23 15:35:59.513704 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 390/787] 10.222.0.30 () {60 vars in 1456 bytes} [Mon May 23 15:35:59 2022] DELETE /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285/os-volume_attachments/8c2b503c-2ffa-46a7-a480-78d336690b29 => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 15:35:59.576656 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-291baaa7-2c73-4385-beaf-be29cfe50cb2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:35:59.577258 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-291baaa7-2c73-4385-beaf-be29cfe50cb2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:59.584029 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-291baaa7-2c73-4385-beaf-be29cfe50cb2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:59.584495 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-291baaa7-2c73-4385-beaf-be29cfe50cb2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:59.585311 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-291baaa7-2c73-4385-beaf-be29cfe50cb2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:59.585757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-291baaa7-2c73-4385-beaf-be29cfe50cb2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:59.666392 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-291baaa7-2c73-4385-beaf-be29cfe50cb2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "POST /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285/action" status: 202 len: 0 microversion: 2.20 time: 0.093635 May 23 15:35:59.667836 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 398/788] 10.222.0.30 () {62 vars in 1318 bytes} [Mon May 23 15:35:59 2022] POST /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 15:35:59.675825 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ceca68bf-0fe4-48a4-b189-b49503701c37 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:59.676635 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ceca68bf-0fe4-48a4-b189-b49503701c37 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:35:59.683233 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ceca68bf-0fe4-48a4-b189-b49503701c37 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:59.683690 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ceca68bf-0fe4-48a4-b189-b49503701c37 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:59.684460 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ceca68bf-0fe4-48a4-b189-b49503701c37 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:35:59.685112 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ceca68bf-0fe4-48a4-b189-b49503701c37 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:35:59.832661 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ceca68bf-0fe4-48a4-b189-b49503701c37 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:59.841020 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ceca68bf-0fe4-48a4-b189-b49503701c37 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:59.842701 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ceca68bf-0fe4-48a4-b189-b49503701c37 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:35:59.844006 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ceca68bf-0fe4-48a4-b189-b49503701c37 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1673 microversion: 2.20 time: 0.172486 May 23 15:35:59.855228 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 391/789] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:35:59 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:36:00.170712 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-34466d3d-70cb-49d6-967b-b7fdf5ed2fd2 req-eb625b7c-555e-44c2-9b22-92786d92f71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5c3bd6-1b7d-4c25-a705-2291f6709285", "name": "network-vif-unplugged", "status": "completed", "tag": "1163c3a8-18a2-4093-9e90-731d856e8076"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:36:00.185354 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-34466d3d-70cb-49d6-967b-b7fdf5ed2fd2 req-eb625b7c-555e-44c2-9b22-92786d92f71b service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:00.186609 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-34466d3d-70cb-49d6-967b-b7fdf5ed2fd2 req-eb625b7c-555e-44c2-9b22-92786d92f71b service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:00.200249 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.compute.server_external_events [req-34466d3d-70cb-49d6-967b-b7fdf5ed2fd2 req-eb625b7c-555e-44c2-9b22-92786d92f71b service nova] Unable to find a host for instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285. Dropping event network-vif-unplugged {{(pid=117974) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 23 15:36:00.201359 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-34466d3d-70cb-49d6-967b-b7fdf5ed2fd2 req-eb625b7c-555e-44c2-9b22-92786d92f71b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036966 May 23 15:36:00.202120 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 399/790] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 23 15:36:00.863243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-22f1b521-177b-4ab7-bf45-b5102b835c4f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:00.863846 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-22f1b521-177b-4ab7-bf45-b5102b835c4f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:00.870673 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-22f1b521-177b-4ab7-bf45-b5102b835c4f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:00.871223 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-22f1b521-177b-4ab7-bf45-b5102b835c4f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:00.872234 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-22f1b521-177b-4ab7-bf45-b5102b835c4f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:00.872754 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-22f1b521-177b-4ab7-bf45-b5102b835c4f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:01.013730 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-22f1b521-177b-4ab7-bf45-b5102b835c4f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:01.024791 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-22f1b521-177b-4ab7-bf45-b5102b835c4f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:01.027285 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-22f1b521-177b-4ab7-bf45-b5102b835c4f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:01.028472 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-22f1b521-177b-4ab7-bf45-b5102b835c4f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1673 microversion: 2.20 time: 0.169394 May 23 15:36:01.029067 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 392/791] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:00 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:36:01.544191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2aebe64f-bdb6-4b13-a704-194e91d4eaa4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:01.545144 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-2aebe64f-bdb6-4b13-a704-194e91d4eaa4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:01.552036 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2aebe64f-bdb6-4b13-a704-194e91d4eaa4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:01.552480 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2aebe64f-bdb6-4b13-a704-194e91d4eaa4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:01.553266 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2aebe64f-bdb6-4b13-a704-194e91d4eaa4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:01.553699 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2aebe64f-bdb6-4b13-a704-194e91d4eaa4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:01.585054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-2aebe64f-bdb6-4b13-a704-194e91d4eaa4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044687 May 23 15:36:01.585727 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 400/792] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:36:01 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:36:01.595622 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c9702cdd-6865-4183-909c-e059e44ce888 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:01.596119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c9702cdd-6865-4183-909c-e059e44ce888 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:01.602145 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c9702cdd-6865-4183-909c-e059e44ce888 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:01.602603 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c9702cdd-6865-4183-909c-e059e44ce888 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:01.603378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c9702cdd-6865-4183-909c-e059e44ce888 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:01.603823 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c9702cdd-6865-4183-909c-e059e44ce888 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:01.633529 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c9702cdd-6865-4183-909c-e059e44ce888 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments/908af409-ec42-4911-95a8-26548ad628e5" status: 200 len: 194 microversion: 2.1 time: 0.041881 May 23 15:36:01.634112 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 393/793] 10.222.0.30 () {58 vars in 1412 bytes} [Mon May 23 15:36:01 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments/908af409-ec42-4911-95a8-26548ad628e5 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:36:02.047114 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-9313cde0-2ee0-4a28-bb60-566cba33e9f4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:02.048667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-9313cde0-2ee0-4a28-bb60-566cba33e9f4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:02.054775 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9313cde0-2ee0-4a28-bb60-566cba33e9f4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:02.055223 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9313cde0-2ee0-4a28-bb60-566cba33e9f4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:02.055990 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9313cde0-2ee0-4a28-bb60-566cba33e9f4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:02.056625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9313cde0-2ee0-4a28-bb60-566cba33e9f4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:02.329757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9313cde0-2ee0-4a28-bb60-566cba33e9f4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:02.343759 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9313cde0-2ee0-4a28-bb60-566cba33e9f4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:02.347897 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9313cde0-2ee0-4a28-bb60-566cba33e9f4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:02.350172 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-9313cde0-2ee0-4a28-bb60-566cba33e9f4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.306687 May 23 15:36:02.351965 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 401/794] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:02 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:36:03.008920 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-545319de-d0d2-44eb-bf42-5932355742eb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55cc5b9b-4d2a-488c-93db-b607530c6e1b"}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:36:03.011181 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-545319de-d0d2-44eb-bf42-5932355742eb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:03.020770 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-545319de-d0d2-44eb-bf42-5932355742eb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:03.021646 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-545319de-d0d2-44eb-bf42-5932355742eb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:03.022947 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-545319de-d0d2-44eb-bf42-5932355742eb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:03.023533 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-545319de-d0d2-44eb-bf42-5932355742eb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:03.370354 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-14877cd7-117a-4a7e-bf5c-bb89c036225c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:03.370968 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-14877cd7-117a-4a7e-bf5c-bb89c036225c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:03.378409 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-14877cd7-117a-4a7e-bf5c-bb89c036225c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:03.378937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-14877cd7-117a-4a7e-bf5c-bb89c036225c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:03.379803 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-14877cd7-117a-4a7e-bf5c-bb89c036225c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:03.380313 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-14877cd7-117a-4a7e-bf5c-bb89c036225c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:03.554496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-14877cd7-117a-4a7e-bf5c-bb89c036225c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:03.564541 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-14877cd7-117a-4a7e-bf5c-bb89c036225c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:03.566226 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-14877cd7-117a-4a7e-bf5c-bb89c036225c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:03.567907 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-14877cd7-117a-4a7e-bf5c-bb89c036225c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.201822 May 23 15:36:03.568546 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 402/795] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:03 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:36:04.587151 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-34b881d8-7e88-47af-8dbf-abc8d7c76bf3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:04.588609 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-34b881d8-7e88-47af-8dbf-abc8d7c76bf3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:04.596560 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-34b881d8-7e88-47af-8dbf-abc8d7c76bf3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:04.597069 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-34b881d8-7e88-47af-8dbf-abc8d7c76bf3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:04.597854 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-34b881d8-7e88-47af-8dbf-abc8d7c76bf3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:04.598305 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-34b881d8-7e88-47af-8dbf-abc8d7c76bf3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:04.741754 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-34b881d8-7e88-47af-8dbf-abc8d7c76bf3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:04.751157 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-34b881d8-7e88-47af-8dbf-abc8d7c76bf3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:04.752767 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-34b881d8-7e88-47af-8dbf-abc8d7c76bf3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:04.754000 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-34b881d8-7e88-47af-8dbf-abc8d7c76bf3 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.171262 May 23 15:36:04.754562 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 403/796] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:04 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:36:05.771686 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-bfb7b8c1-66e2-425b-9e12-c8c4e6631133 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:05.772622 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-bfb7b8c1-66e2-425b-9e12-c8c4e6631133 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:05.781319 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bfb7b8c1-66e2-425b-9e12-c8c4e6631133 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:05.783117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bfb7b8c1-66e2-425b-9e12-c8c4e6631133 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:05.784107 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bfb7b8c1-66e2-425b-9e12-c8c4e6631133 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:05.784661 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bfb7b8c1-66e2-425b-9e12-c8c4e6631133 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:05.922714 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-bfb7b8c1-66e2-425b-9e12-c8c4e6631133 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:05.930805 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-bfb7b8c1-66e2-425b-9e12-c8c4e6631133 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:05.932320 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-bfb7b8c1-66e2-425b-9e12-c8c4e6631133 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:05.933515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-bfb7b8c1-66e2-425b-9e12-c8c4e6631133 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.165726 May 23 15:36:05.934078 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 404/797] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:05 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:36:06.952181 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-1c93c544-ba26-4e52-b982-f9bd8759b009 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:06.952816 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-1c93c544-ba26-4e52-b982-f9bd8759b009 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:06.959404 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1c93c544-ba26-4e52-b982-f9bd8759b009 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:06.959863 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1c93c544-ba26-4e52-b982-f9bd8759b009 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:06.960632 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1c93c544-ba26-4e52-b982-f9bd8759b009 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:06.961101 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1c93c544-ba26-4e52-b982-f9bd8759b009 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:07.100127 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1c93c544-ba26-4e52-b982-f9bd8759b009 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:07.107993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1c93c544-ba26-4e52-b982-f9bd8759b009 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:07.109533 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1c93c544-ba26-4e52-b982-f9bd8759b009 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:07.111446 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-1c93c544-ba26-4e52-b982-f9bd8759b009 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.163313 May 23 15:36:07.112014 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 405/798] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:06 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:36:08.129436 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-0fd87b3e-ce78-4300-b097-0a12591823a7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:08.130139 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-0fd87b3e-ce78-4300-b097-0a12591823a7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:08.136705 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fd87b3e-ce78-4300-b097-0a12591823a7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:08.137520 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fd87b3e-ce78-4300-b097-0a12591823a7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:08.138294 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fd87b3e-ce78-4300-b097-0a12591823a7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:08.138735 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fd87b3e-ce78-4300-b097-0a12591823a7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:08.271276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0fd87b3e-ce78-4300-b097-0a12591823a7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:08.273751 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:08.287379 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0fd87b3e-ce78-4300-b097-0a12591823a7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:08.289588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0fd87b3e-ce78-4300-b097-0a12591823a7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:08.291197 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-0fd87b3e-ce78-4300-b097-0a12591823a7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.166441 May 23 15:36:08.292068 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 406/799] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:08 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:36:09.310675 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-98d93c61-d3e7-4776-9d2c-ad62c822ebda tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:09.311326 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-98d93c61-d3e7-4776-9d2c-ad62c822ebda tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:09.319188 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-98d93c61-d3e7-4776-9d2c-ad62c822ebda tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:09.319631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-98d93c61-d3e7-4776-9d2c-ad62c822ebda tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:09.320406 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-98d93c61-d3e7-4776-9d2c-ad62c822ebda tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:09.320836 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-98d93c61-d3e7-4776-9d2c-ad62c822ebda tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:09.466528 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-98d93c61-d3e7-4776-9d2c-ad62c822ebda tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:09.474827 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-98d93c61-d3e7-4776-9d2c-ad62c822ebda tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:09.476348 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-98d93c61-d3e7-4776-9d2c-ad62c822ebda tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:09.477560 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-98d93c61-d3e7-4776-9d2c-ad62c822ebda tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.170978 May 23 15:36:09.489989 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 407/800] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:09 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:36:10.496209 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f2a1d064-b1a2-4f37-8eb9-f586ddb77fd2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:10.497046 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f2a1d064-b1a2-4f37-8eb9-f586ddb77fd2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:10.504691 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f2a1d064-b1a2-4f37-8eb9-f586ddb77fd2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:10.510413 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f2a1d064-b1a2-4f37-8eb9-f586ddb77fd2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:10.510413 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f2a1d064-b1a2-4f37-8eb9-f586ddb77fd2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:10.510413 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f2a1d064-b1a2-4f37-8eb9-f586ddb77fd2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:10.650017 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-f2a1d064-b1a2-4f37-8eb9-f586ddb77fd2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:10.659549 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-f2a1d064-b1a2-4f37-8eb9-f586ddb77fd2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:10.661494 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-f2a1d064-b1a2-4f37-8eb9-f586ddb77fd2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:10.663032 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f2a1d064-b1a2-4f37-8eb9-f586ddb77fd2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.170816 May 23 15:36:10.673574 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 408/801] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:10 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:36:10.880960 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8f730ce7-c1bd-4aa0-84cf-b3a43a25cd9a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:10.881736 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8f730ce7-c1bd-4aa0-84cf-b3a43a25cd9a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:10.888109 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8f730ce7-c1bd-4aa0-84cf-b3a43a25cd9a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:10.888566 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8f730ce7-c1bd-4aa0-84cf-b3a43a25cd9a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:10.889621 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8f730ce7-c1bd-4aa0-84cf-b3a43a25cd9a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:10.890072 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8f730ce7-c1bd-4aa0-84cf-b3a43a25cd9a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:10.917312 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8f730ce7-c1bd-4aa0-84cf-b3a43a25cd9a tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/ips" status: 200 len: 149 microversion: 2.1 time: 0.040885 May 23 15:36:10.917754 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 409/802] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 15:36:10 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:36:11.681156 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8cbbea8d-47f3-4adb-9841-4c76db5e1ddd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:11.681771 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8cbbea8d-47f3-4adb-9841-4c76db5e1ddd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:11.690106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8cbbea8d-47f3-4adb-9841-4c76db5e1ddd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:11.690552 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8cbbea8d-47f3-4adb-9841-4c76db5e1ddd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:11.691322 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8cbbea8d-47f3-4adb-9841-4c76db5e1ddd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:11.691892 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8cbbea8d-47f3-4adb-9841-4c76db5e1ddd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:11.888744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-8cbbea8d-47f3-4adb-9841-4c76db5e1ddd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:11.905775 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-8cbbea8d-47f3-4adb-9841-4c76db5e1ddd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:11.907924 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-8cbbea8d-47f3-4adb-9841-4c76db5e1ddd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:11.909664 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8cbbea8d-47f3-4adb-9841-4c76db5e1ddd tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.232416 May 23 15:36:11.910524 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 410/803] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:11 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:36:12.332966 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f6592e81-c967-4c58-b749-b32ebe029e7d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20dd2dbd-fd03-4bb0-9732-2c8e11be673e"}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:36:12.334191 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f6592e81-c967-4c58-b749-b32ebe029e7d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:12.340243 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f6592e81-c967-4c58-b749-b32ebe029e7d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:12.340769 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f6592e81-c967-4c58-b749-b32ebe029e7d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:12.341570 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f6592e81-c967-4c58-b749-b32ebe029e7d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:12.342010 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f6592e81-c967-4c58-b749-b32ebe029e7d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:13.017405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=11 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:13.067246 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-545319de-d0d2-44eb-bf42-5932355742eb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "POST /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.063483 May 23 15:36:13.068023 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 394/804] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 15:36:03 2022] POST /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments => generated 194 bytes in 10065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:36:13.074434 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-98a461c5-c431-4591-8b4e-b430193ba2ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:13.075151 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-98a461c5-c431-4591-8b4e-b430193ba2ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:13.084382 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-98a461c5-c431-4591-8b4e-b430193ba2ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:13.084672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-98a461c5-c431-4591-8b4e-b430193ba2ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:13.085716 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-98a461c5-c431-4591-8b4e-b430193ba2ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:13.086273 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-98a461c5-c431-4591-8b4e-b430193ba2ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:13.104219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f6592e81-c967-4c58-b749-b32ebe029e7d tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "POST /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.775761 May 23 15:36:13.104834 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 411/805] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 15:36:12 2022] POST /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/os-volume_attachments => generated 194 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:36:13.249936 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-98a461c5-c431-4591-8b4e-b430193ba2ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:13.262593 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-98a461c5-c431-4591-8b4e-b430193ba2ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:13.264134 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-98a461c5-c431-4591-8b4e-b430193ba2ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:13.265345 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-98a461c5-c431-4591-8b4e-b430193ba2ae tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.196243 May 23 15:36:13.265895 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 395/806] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:13 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:36:14.287032 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5ec557d3-bfab-4715-b54b-fa28f5ce7892 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:14.289035 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-5ec557d3-bfab-4715-b54b-fa28f5ce7892 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:14.294405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=52 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:14.300218 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5ec557d3-bfab-4715-b54b-fa28f5ce7892 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:14.300817 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5ec557d3-bfab-4715-b54b-fa28f5ce7892 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:14.302105 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5ec557d3-bfab-4715-b54b-fa28f5ce7892 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:14.302803 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5ec557d3-bfab-4715-b54b-fa28f5ce7892 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:14.457706 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-5ec557d3-bfab-4715-b54b-fa28f5ce7892 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:14.467292 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-5ec557d3-bfab-4715-b54b-fa28f5ce7892 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:14.468791 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-5ec557d3-bfab-4715-b54b-fa28f5ce7892 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:14.470518 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5ec557d3-bfab-4715-b54b-fa28f5ce7892 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.189886 May 23 15:36:14.471280 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 412/807] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:14 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:36:15.490638 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d62f005c-8c04-4f59-9423-bebb148b522e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:15.491188 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d62f005c-8c04-4f59-9423-bebb148b522e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:15.497668 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d62f005c-8c04-4f59-9423-bebb148b522e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:15.498118 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d62f005c-8c04-4f59-9423-bebb148b522e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:15.498884 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d62f005c-8c04-4f59-9423-bebb148b522e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:15.499321 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d62f005c-8c04-4f59-9423-bebb148b522e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:15.639854 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d62f005c-8c04-4f59-9423-bebb148b522e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:15.649284 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d62f005c-8c04-4f59-9423-bebb148b522e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:15.650815 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d62f005c-8c04-4f59-9423-bebb148b522e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:15.652086 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d62f005c-8c04-4f59-9423-bebb148b522e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.167527 May 23 15:36:15.652715 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 396/808] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:15 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:36:16.671433 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-70dab156-b0ff-4496-b67a-2c5a5dcd249e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:16.672052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-70dab156-b0ff-4496-b67a-2c5a5dcd249e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:16.679086 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-70dab156-b0ff-4496-b67a-2c5a5dcd249e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:16.679541 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-70dab156-b0ff-4496-b67a-2c5a5dcd249e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:16.680313 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-70dab156-b0ff-4496-b67a-2c5a5dcd249e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:16.680753 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-70dab156-b0ff-4496-b67a-2c5a5dcd249e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:16.814552 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-70dab156-b0ff-4496-b67a-2c5a5dcd249e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:16.822823 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-70dab156-b0ff-4496-b67a-2c5a5dcd249e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:16.824363 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-70dab156-b0ff-4496-b67a-2c5a5dcd249e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:16.825578 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-70dab156-b0ff-4496-b67a-2c5a5dcd249e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.158074 May 23 15:36:16.826135 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 413/809] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:16 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:36:17.061942 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-3a7b2cbc-5427-4d4d-bbc7-94922f2c201a req-9b7733e5-2e24-47c2-90bb-94e8bbebda9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5c3bd6-1b7d-4c25-a705-2291f6709285", "name": "network-vif-plugged", "status": "completed", "tag": "1163c3a8-18a2-4093-9e90-731d856e8076"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:36:17.073390 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-3a7b2cbc-5427-4d4d-bbc7-94922f2c201a req-9b7733e5-2e24-47c2-90bb-94e8bbebda9b service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:17.073928 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-3a7b2cbc-5427-4d4d-bbc7-94922f2c201a req-9b7733e5-2e24-47c2-90bb-94e8bbebda9b service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:17.085753 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-3a7b2cbc-5427-4d4d-bbc7-94922f2c201a req-9b7733e5-2e24-47c2-90bb-94e8bbebda9b service nova] Creating event network-vif-plugged:1163c3a8-18a2-4093-9e90-731d856e8076 for instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 on hv-cinder-84112 May 23 15:36:17.090795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-3a7b2cbc-5427-4d4d-bbc7-94922f2c201a req-9b7733e5-2e24-47c2-90bb-94e8bbebda9b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032668 May 23 15:36:17.091690 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 397/810] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:36:17.843394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b863dfb9-0cf9-4d3d-89c0-081b023f114c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:17.844003 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b863dfb9-0cf9-4d3d-89c0-081b023f114c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:17.852618 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b863dfb9-0cf9-4d3d-89c0-081b023f114c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:17.853107 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b863dfb9-0cf9-4d3d-89c0-081b023f114c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:17.853892 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b863dfb9-0cf9-4d3d-89c0-081b023f114c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:17.854337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b863dfb9-0cf9-4d3d-89c0-081b023f114c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:17.984690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b863dfb9-0cf9-4d3d-89c0-081b023f114c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:17.993146 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b863dfb9-0cf9-4d3d-89c0-081b023f114c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:17.994656 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b863dfb9-0cf9-4d3d-89c0-081b023f114c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:17.995857 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b863dfb9-0cf9-4d3d-89c0-081b023f114c tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.156387 May 23 15:36:17.996420 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 414/811] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:17 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:36:19.014335 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d005983a-0977-4d8f-a2a8-3cef35b03371 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:19.015042 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d005983a-0977-4d8f-a2a8-3cef35b03371 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:19.021921 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d005983a-0977-4d8f-a2a8-3cef35b03371 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:19.022388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d005983a-0977-4d8f-a2a8-3cef35b03371 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:19.023438 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d005983a-0977-4d8f-a2a8-3cef35b03371 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:19.023888 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d005983a-0977-4d8f-a2a8-3cef35b03371 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:19.152155 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d005983a-0977-4d8f-a2a8-3cef35b03371 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:19.163422 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d005983a-0977-4d8f-a2a8-3cef35b03371 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:19.164973 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d005983a-0977-4d8f-a2a8-3cef35b03371 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:19.166265 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d005983a-0977-4d8f-a2a8-3cef35b03371 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.156239 May 23 15:36:19.166842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 398/812] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:19 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:36:20.183936 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a4792cd3-9603-4272-ac1d-161608ab7e30 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:20.184969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a4792cd3-9603-4272-ac1d-161608ab7e30 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:20.191506 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a4792cd3-9603-4272-ac1d-161608ab7e30 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:20.191954 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a4792cd3-9603-4272-ac1d-161608ab7e30 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:20.192888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a4792cd3-9603-4272-ac1d-161608ab7e30 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:20.193228 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a4792cd3-9603-4272-ac1d-161608ab7e30 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:20.331233 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a4792cd3-9603-4272-ac1d-161608ab7e30 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:20.339395 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a4792cd3-9603-4272-ac1d-161608ab7e30 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:20.341093 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a4792cd3-9603-4272-ac1d-161608ab7e30 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:20.342307 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a4792cd3-9603-4272-ac1d-161608ab7e30 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.162419 May 23 15:36:20.342911 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 415/813] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:20 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:36:20.597344 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-450770e5-8846-4ebb-8b52-b90c44d25f07 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:20.598307 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-450770e5-8846-4ebb-8b52-b90c44d25f07 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:20.604970 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-450770e5-8846-4ebb-8b52-b90c44d25f07 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:20.605433 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-450770e5-8846-4ebb-8b52-b90c44d25f07 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:20.606207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-450770e5-8846-4ebb-8b52-b90c44d25f07 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:20.606649 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-450770e5-8846-4ebb-8b52-b90c44d25f07 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:20.636614 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-450770e5-8846-4ebb-8b52-b90c44d25f07 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043469 May 23 15:36:20.637193 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 399/814] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:36:20 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:36:20.780244 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-9e887245-ab33-4b22-821b-8d94b0241765 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:20.780745 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-9e887245-ab33-4b22-821b-8d94b0241765 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:20.787099 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9e887245-ab33-4b22-821b-8d94b0241765 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:20.787557 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9e887245-ab33-4b22-821b-8d94b0241765 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:20.788326 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9e887245-ab33-4b22-821b-8d94b0241765 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:20.788770 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9e887245-ab33-4b22-821b-8d94b0241765 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:20.818731 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-9e887245-ab33-4b22-821b-8d94b0241765 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments/908af409-ec42-4911-95a8-26548ad628e5" status: 200 len: 194 microversion: 2.1 time: 0.042356 May 23 15:36:20.819591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 416/815] 10.222.0.30 () {58 vars in 1412 bytes} [Mon May 23 15:36:20 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments/908af409-ec42-4911-95a8-26548ad628e5 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:36:20.829751 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-0fc75c54-96a7-468a-a5b5-c85243d0c7c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:20.830287 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-0fc75c54-96a7-468a-a5b5-c85243d0c7c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:20.836205 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0fc75c54-96a7-468a-a5b5-c85243d0c7c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:20.836597 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0fc75c54-96a7-468a-a5b5-c85243d0c7c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:20.837383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0fc75c54-96a7-468a-a5b5-c85243d0c7c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:20.837821 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0fc75c54-96a7-468a-a5b5-c85243d0c7c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:20.841672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:UPDATE=8,nova_cell1:SELECT=88,nova_cell1:INSERT=4 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:20.918723 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.objects.instance [None req-0fc75c54-96a7-468a-a5b5-c85243d0c7c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lazy-loading 'services' on Instance uuid 2b2fc89f-88e8-42b3-9006-35470a9f74fc {{(pid=117973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:36:20.989946 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-0fc75c54-96a7-468a-a5b5-c85243d0c7c4 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments/908af409-ec42-4911-95a8-26548ad628e5" status: 202 len: 0 microversion: 2.1 time: 0.164645 May 23 15:36:20.990529 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 400/816] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 15:36:20 2022] DELETE /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments/908af409-ec42-4911-95a8-26548ad628e5 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:36:21.361691 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-6798d1d8-861b-4a21-a19f-618b3c92008e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:21.362310 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-6798d1d8-861b-4a21-a19f-618b3c92008e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:21.368774 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6798d1d8-861b-4a21-a19f-618b3c92008e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:21.369261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6798d1d8-861b-4a21-a19f-618b3c92008e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:21.370023 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6798d1d8-861b-4a21-a19f-618b3c92008e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:21.370460 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6798d1d8-861b-4a21-a19f-618b3c92008e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:21.496250 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-6798d1d8-861b-4a21-a19f-618b3c92008e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:21.504644 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-6798d1d8-861b-4a21-a19f-618b3c92008e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:21.506227 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-6798d1d8-861b-4a21-a19f-618b3c92008e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:21.507436 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-6798d1d8-861b-4a21-a19f-618b3c92008e tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.150311 May 23 15:36:21.507988 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 417/817] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:21 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:36:22.527200 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a532e45e-cade-4653-b2ad-99ceaf79a0f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:22.527909 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-a532e45e-cade-4653-b2ad-99ceaf79a0f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:22.534354 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a532e45e-cade-4653-b2ad-99ceaf79a0f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:22.534814 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a532e45e-cade-4653-b2ad-99ceaf79a0f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:22.535588 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a532e45e-cade-4653-b2ad-99ceaf79a0f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:22.536035 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a532e45e-cade-4653-b2ad-99ceaf79a0f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:22.671929 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a532e45e-cade-4653-b2ad-99ceaf79a0f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:22.680566 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a532e45e-cade-4653-b2ad-99ceaf79a0f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:22.682097 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a532e45e-cade-4653-b2ad-99ceaf79a0f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:22.683267 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a532e45e-cade-4653-b2ad-99ceaf79a0f7 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.161129 May 23 15:36:22.683825 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 401/818] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:22 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:36:23.701319 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a87b163a-e4e4-43d5-b721-f34057c24eaf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:23.701925 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a87b163a-e4e4-43d5-b721-f34057c24eaf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:23.709158 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a87b163a-e4e4-43d5-b721-f34057c24eaf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:23.709610 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a87b163a-e4e4-43d5-b721-f34057c24eaf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:23.710382 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a87b163a-e4e4-43d5-b721-f34057c24eaf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:23.710818 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a87b163a-e4e4-43d5-b721-f34057c24eaf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:23.841311 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a87b163a-e4e4-43d5-b721-f34057c24eaf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:23.851216 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a87b163a-e4e4-43d5-b721-f34057c24eaf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:23.852752 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a87b163a-e4e4-43d5-b721-f34057c24eaf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:23.853963 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a87b163a-e4e4-43d5-b721-f34057c24eaf tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.156521 May 23 15:36:23.854803 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 418/819] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:23 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:36:24.876535 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b001b3e7-1505-4c67-bfd6-38710af6feb2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:24.877185 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b001b3e7-1505-4c67-bfd6-38710af6feb2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:24.883648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b001b3e7-1505-4c67-bfd6-38710af6feb2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:24.884042 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b001b3e7-1505-4c67-bfd6-38710af6feb2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:24.884807 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b001b3e7-1505-4c67-bfd6-38710af6feb2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:24.885269 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b001b3e7-1505-4c67-bfd6-38710af6feb2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:25.016396 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b001b3e7-1505-4c67-bfd6-38710af6feb2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:25.025576 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b001b3e7-1505-4c67-bfd6-38710af6feb2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:25.027357 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b001b3e7-1505-4c67-bfd6-38710af6feb2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:25.028628 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b001b3e7-1505-4c67-bfd6-38710af6feb2 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1731 microversion: 2.20 time: 0.155931 May 23 15:36:25.029092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 402/820] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:24 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:36:26.047479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3c9aaeef-2343-4a10-b24f-9f5e136bd154 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:26.048628 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3c9aaeef-2343-4a10-b24f-9f5e136bd154 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:26.055103 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3c9aaeef-2343-4a10-b24f-9f5e136bd154 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:26.055557 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3c9aaeef-2343-4a10-b24f-9f5e136bd154 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:26.056320 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3c9aaeef-2343-4a10-b24f-9f5e136bd154 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:26.056760 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3c9aaeef-2343-4a10-b24f-9f5e136bd154 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:26.184271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3c9aaeef-2343-4a10-b24f-9f5e136bd154 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:26.192829 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3c9aaeef-2343-4a10-b24f-9f5e136bd154 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:26.194474 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3c9aaeef-2343-4a10-b24f-9f5e136bd154 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:26.195722 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3c9aaeef-2343-4a10-b24f-9f5e136bd154 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1718 microversion: 2.20 time: 0.152102 May 23 15:36:26.196315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 419/821] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:26 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:36:31.410730 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-92b4d676-f70f-4d9c-bb0b-f6d712821390 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:31.411394 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-92b4d676-f70f-4d9c-bb0b-f6d712821390 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:31.418354 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-92b4d676-f70f-4d9c-bb0b-f6d712821390 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:31.418903 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-92b4d676-f70f-4d9c-bb0b-f6d712821390 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:31.419749 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-92b4d676-f70f-4d9c-bb0b-f6d712821390 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:31.420289 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-92b4d676-f70f-4d9c-bb0b-f6d712821390 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:31.505645 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.objects.instance [None req-92b4d676-f70f-4d9c-bb0b-f6d712821390 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lazy-loading 'services' on Instance uuid 7cb5b773-cad7-4825-8550-efc0cebf77ac {{(pid=117973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:36:31.577651 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-92b4d676-f70f-4d9c-bb0b-f6d712821390 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/os-volume_attachments/20dd2dbd-fd03-4bb0-9732-2c8e11be673e" status: 202 len: 0 microversion: 2.1 time: 0.171478 May 23 15:36:31.578500 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 403/822] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 15:36:31 2022] DELETE /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/os-volume_attachments/20dd2dbd-fd03-4bb0-9732-2c8e11be673e => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:36:31.588289 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-68cc3a09-8648-4bd2-98c6-296f9a1354d2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:31.589389 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-68cc3a09-8648-4bd2-98c6-296f9a1354d2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:31.597774 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-68cc3a09-8648-4bd2-98c6-296f9a1354d2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:31.598364 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-68cc3a09-8648-4bd2-98c6-296f9a1354d2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:31.599395 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-68cc3a09-8648-4bd2-98c6-296f9a1354d2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:31.599957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-68cc3a09-8648-4bd2-98c6-296f9a1354d2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:31.638441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-68cc3a09-8648-4bd2-98c6-296f9a1354d2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054801 May 23 15:36:31.639489 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 420/823] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:36:31 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:36:31.746011 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c9f7f6da-38d6-4f15-abb1-4dbadadc3f40 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:31.746593 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c9f7f6da-38d6-4f15-abb1-4dbadadc3f40 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:31.753005 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c9f7f6da-38d6-4f15-abb1-4dbadadc3f40 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:31.753453 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c9f7f6da-38d6-4f15-abb1-4dbadadc3f40 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:31.754211 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c9f7f6da-38d6-4f15-abb1-4dbadadc3f40 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:31.754648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c9f7f6da-38d6-4f15-abb1-4dbadadc3f40 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:31.783848 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c9f7f6da-38d6-4f15-abb1-4dbadadc3f40 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments/55cc5b9b-4d2a-488c-93db-b607530c6e1b" status: 200 len: 194 microversion: 2.1 time: 0.042022 May 23 15:36:31.784349 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 404/824] 10.222.0.30 () {58 vars in 1412 bytes} [Mon May 23 15:36:31 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments/55cc5b9b-4d2a-488c-93db-b607530c6e1b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:36:31.794094 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b215202e-580f-46af-8b6a-7db63ea629a3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:31.794596 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b215202e-580f-46af-8b6a-7db63ea629a3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:31.800816 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b215202e-580f-46af-8b6a-7db63ea629a3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:31.801297 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b215202e-580f-46af-8b6a-7db63ea629a3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:31.802060 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b215202e-580f-46af-8b6a-7db63ea629a3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:31.802494 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b215202e-580f-46af-8b6a-7db63ea629a3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:31.885020 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-b215202e-580f-46af-8b6a-7db63ea629a3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lazy-loading 'services' on Instance uuid 2b2fc89f-88e8-42b3-9006-35470a9f74fc {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:36:31.946389 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:31.961662 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b215202e-580f-46af-8b6a-7db63ea629a3 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments/55cc5b9b-4d2a-488c-93db-b607530c6e1b" status: 202 len: 0 microversion: 2.1 time: 0.171278 May 23 15:36:31.962617 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 421/825] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 15:36:31 2022] DELETE /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments/55cc5b9b-4d2a-488c-93db-b607530c6e1b => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:36:32.651762 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-09f0b19f-c6ac-4c2d-b803-2594771872a5 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:32.652760 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-09f0b19f-c6ac-4c2d-b803-2594771872a5 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:32.659474 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-09f0b19f-c6ac-4c2d-b803-2594771872a5 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:32.659916 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-09f0b19f-c6ac-4c2d-b803-2594771872a5 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:32.660676 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-09f0b19f-c6ac-4c2d-b803-2594771872a5 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:32.661150 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-09f0b19f-c6ac-4c2d-b803-2594771872a5 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:32.691319 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-09f0b19f-c6ac-4c2d-b803-2594771872a5 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043730 May 23 15:36:32.691866 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 405/826] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:36:32 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:36:33.705050 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c920cf8b-ac66-4702-b6fb-f73d704c3ce9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:33.706049 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-c920cf8b-ac66-4702-b6fb-f73d704c3ce9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:33.712384 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c920cf8b-ac66-4702-b6fb-f73d704c3ce9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:33.712829 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c920cf8b-ac66-4702-b6fb-f73d704c3ce9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:33.713653 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c920cf8b-ac66-4702-b6fb-f73d704c3ce9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:33.714089 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c920cf8b-ac66-4702-b6fb-f73d704c3ce9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:33.743383 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-c920cf8b-ac66-4702-b6fb-f73d704c3ce9 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 May 23 15:36:33.743931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 422/827] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:36:33 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:36:34.757893 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-560c0ab7-6788-43c5-9a89-af428a6a48a2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:34.759039 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-560c0ab7-6788-43c5-9a89-af428a6a48a2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:34.765669 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-560c0ab7-6788-43c5-9a89-af428a6a48a2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:34.766138 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-560c0ab7-6788-43c5-9a89-af428a6a48a2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:34.767421 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-560c0ab7-6788-43c5-9a89-af428a6a48a2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:34.767857 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-560c0ab7-6788-43c5-9a89-af428a6a48a2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:34.800152 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-560c0ab7-6788-43c5-9a89-af428a6a48a2 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048969 May 23 15:36:34.800705 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 406/828] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:36:34 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:36:35.812306 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-427e43af-5b49-43c4-bb70-de333bb98321 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:35.815674 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-427e43af-5b49-43c4-bb70-de333bb98321 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:35.822960 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-427e43af-5b49-43c4-bb70-de333bb98321 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:35.823408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-427e43af-5b49-43c4-bb70-de333bb98321 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:35.824189 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-427e43af-5b49-43c4-bb70-de333bb98321 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:35.824653 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-427e43af-5b49-43c4-bb70-de333bb98321 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:35.852466 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-427e43af-5b49-43c4-bb70-de333bb98321 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044575 May 23 15:36:35.853042 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 423/829] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:36:35 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:36:35.911623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b6eebaef-9718-4564-bb98-1b616cb803ba tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:35.912115 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b6eebaef-9718-4564-bb98-1b616cb803ba tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:35.918488 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b6eebaef-9718-4564-bb98-1b616cb803ba tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:35.918932 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b6eebaef-9718-4564-bb98-1b616cb803ba tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:35.919687 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b6eebaef-9718-4564-bb98-1b616cb803ba tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:35.920122 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b6eebaef-9718-4564-bb98-1b616cb803ba tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:35.946591 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b6eebaef-9718-4564-bb98-1b616cb803ba tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Going to try to terminate instance {{(pid=117973) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:36:36.024168 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b6eebaef-9718-4564-bb98-1b616cb803ba tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 204 len: 0 microversion: 2.1 time: 0.116291 May 23 15:36:36.024987 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 407/830] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:36:35 2022] DELETE /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:36:36.033109 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5576a945-7f31-4d75-ad29-914f6f435111 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:36.033768 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-5576a945-7f31-4d75-ad29-914f6f435111 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:36.039945 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5576a945-7f31-4d75-ad29-914f6f435111 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:36.040397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5576a945-7f31-4d75-ad29-914f6f435111 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:36.041204 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5576a945-7f31-4d75-ad29-914f6f435111 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:36.041645 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5576a945-7f31-4d75-ad29-914f6f435111 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:36.172349 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-5576a945-7f31-4d75-ad29-914f6f435111 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:36.180911 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5576a945-7f31-4d75-ad29-914f6f435111 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 200 len: 1680 microversion: 2.1 time: 0.151738 May 23 15:36:36.181809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 424/831] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:36 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:36:36.277670 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-57d6c41c-9f37-445a-9ec8-a2b6006b79d8 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:36.278727 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-57d6c41c-9f37-445a-9ec8-a2b6006b79d8 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:36.285506 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-57d6c41c-9f37-445a-9ec8-a2b6006b79d8 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:36.285968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-57d6c41c-9f37-445a-9ec8-a2b6006b79d8 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:36.286788 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-57d6c41c-9f37-445a-9ec8-a2b6006b79d8 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:36.287224 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-57d6c41c-9f37-445a-9ec8-a2b6006b79d8 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:36.316806 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-57d6c41c-9f37-445a-9ec8-a2b6006b79d8 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043887 May 23 15:36:36.317388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 408/832] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:36:36 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:36:36.421220 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a4b30c69-61ea-4cff-a562-1368866dcc12 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:36.422139 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a4b30c69-61ea-4cff-a562-1368866dcc12 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:36.429011 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a4b30c69-61ea-4cff-a562-1368866dcc12 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:36.429460 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a4b30c69-61ea-4cff-a562-1368866dcc12 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:36.430216 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a4b30c69-61ea-4cff-a562-1368866dcc12 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:36.430646 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a4b30c69-61ea-4cff-a562-1368866dcc12 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:36.459197 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a4b30c69-61ea-4cff-a562-1368866dcc12 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041949 May 23 15:36:36.459738 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 425/833] 10.222.0.30 () {58 vars in 1301 bytes} [Mon May 23 15:36:36 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:36:36.516516 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b05d3eeb-de30-418d-a521-81254e8f5ecb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:36.517106 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b05d3eeb-de30-418d-a521-81254e8f5ecb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:36.522995 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b05d3eeb-de30-418d-a521-81254e8f5ecb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:36.523445 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b05d3eeb-de30-418d-a521-81254e8f5ecb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:36.524460 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b05d3eeb-de30-418d-a521-81254e8f5ecb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:36.524928 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b05d3eeb-de30-418d-a521-81254e8f5ecb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:36.553268 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b05d3eeb-de30-418d-a521-81254e8f5ecb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Going to try to terminate instance {{(pid=117973) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:36:36.631385 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b05d3eeb-de30-418d-a521-81254e8f5ecb tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 204 len: 0 microversion: 2.1 time: 0.118425 May 23 15:36:36.631972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 409/834] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:36:36 2022] DELETE /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:36:36.640014 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-1bfdc836-6f94-4691-ab52-464412d99f87 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:36.640636 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-1bfdc836-6f94-4691-ab52-464412d99f87 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:36.647180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1bfdc836-6f94-4691-ab52-464412d99f87 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:36.647636 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1bfdc836-6f94-4691-ab52-464412d99f87 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:36.648406 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1bfdc836-6f94-4691-ab52-464412d99f87 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:36.648880 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1bfdc836-6f94-4691-ab52-464412d99f87 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:36.776390 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1bfdc836-6f94-4691-ab52-464412d99f87 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:36.784493 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-1bfdc836-6f94-4691-ab52-464412d99f87 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1672 microversion: 2.1 time: 0.148269 May 23 15:36:36.785093 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 426/835] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:36 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:36:37.199045 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-bc5c5176-d3bb-4006-ac01-72c2f237a8dc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:37.199751 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-bc5c5176-d3bb-4006-ac01-72c2f237a8dc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:37.206795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bc5c5176-d3bb-4006-ac01-72c2f237a8dc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:37.207272 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bc5c5176-d3bb-4006-ac01-72c2f237a8dc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:37.208040 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bc5c5176-d3bb-4006-ac01-72c2f237a8dc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:37.208475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bc5c5176-d3bb-4006-ac01-72c2f237a8dc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:37.339012 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-bc5c5176-d3bb-4006-ac01-72c2f237a8dc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:37.346733 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-bc5c5176-d3bb-4006-ac01-72c2f237a8dc tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 200 len: 1680 microversion: 2.1 time: 0.151957 May 23 15:36:37.347301 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 410/836] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:37 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:36:37.802741 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8f95e6c0-b7c4-4614-9033-293b147fd33c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:37.803357 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8f95e6c0-b7c4-4614-9033-293b147fd33c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:37.809779 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8f95e6c0-b7c4-4614-9033-293b147fd33c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:37.810237 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8f95e6c0-b7c4-4614-9033-293b147fd33c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:37.811001 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8f95e6c0-b7c4-4614-9033-293b147fd33c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:37.811443 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8f95e6c0-b7c4-4614-9033-293b147fd33c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:37.940469 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-8f95e6c0-b7c4-4614-9033-293b147fd33c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:37.947933 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8f95e6c0-b7c4-4614-9033-293b147fd33c tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1672 microversion: 2.1 time: 0.149722 May 23 15:36:37.948494 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 427/837] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:37 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:36:38.364361 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a3785b6d-b652-4c72-811d-04a85dd8b253 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:38.364976 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-a3785b6d-b652-4c72-811d-04a85dd8b253 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:38.371440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a3785b6d-b652-4c72-811d-04a85dd8b253 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:38.371888 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a3785b6d-b652-4c72-811d-04a85dd8b253 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:38.372645 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a3785b6d-b652-4c72-811d-04a85dd8b253 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:38.373117 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a3785b6d-b652-4c72-811d-04a85dd8b253 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:38.501523 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a3785b6d-b652-4c72-811d-04a85dd8b253 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:38.509029 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a3785b6d-b652-4c72-811d-04a85dd8b253 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 200 len: 1680 microversion: 2.1 time: 0.149008 May 23 15:36:38.509599 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 411/838] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:38 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:36:38.965316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-683bfdaf-fa6b-462b-bbd0-4ae41f891196 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:38.966050 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-683bfdaf-fa6b-462b-bbd0-4ae41f891196 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:38.973433 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-683bfdaf-fa6b-462b-bbd0-4ae41f891196 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:38.973881 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-683bfdaf-fa6b-462b-bbd0-4ae41f891196 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:38.974681 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-683bfdaf-fa6b-462b-bbd0-4ae41f891196 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:38.975119 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-683bfdaf-fa6b-462b-bbd0-4ae41f891196 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:39.109963 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-683bfdaf-fa6b-462b-bbd0-4ae41f891196 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:39.117613 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-683bfdaf-fa6b-462b-bbd0-4ae41f891196 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1672 microversion: 2.1 time: 0.156111 May 23 15:36:39.118234 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 428/839] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:38 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:36:39.526851 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-00917f0b-c377-44b9-aeb6-9ba59086b5a1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:39.527461 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-00917f0b-c377-44b9-aeb6-9ba59086b5a1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:39.534040 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-00917f0b-c377-44b9-aeb6-9ba59086b5a1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:39.534489 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-00917f0b-c377-44b9-aeb6-9ba59086b5a1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:39.535247 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-00917f0b-c377-44b9-aeb6-9ba59086b5a1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:39.535691 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-00917f0b-c377-44b9-aeb6-9ba59086b5a1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:39.539735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:39.672524 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-00917f0b-c377-44b9-aeb6-9ba59086b5a1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:39.680743 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-00917f0b-c377-44b9-aeb6-9ba59086b5a1 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 200 len: 1680 microversion: 2.1 time: 0.158068 May 23 15:36:39.681351 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 412/840] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:39 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:36:40.134527 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b2c96a99-eaff-4c60-bb5e-616c30cf5481 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:40.135152 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b2c96a99-eaff-4c60-bb5e-616c30cf5481 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:40.141809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b2c96a99-eaff-4c60-bb5e-616c30cf5481 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:40.142320 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b2c96a99-eaff-4c60-bb5e-616c30cf5481 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:40.143117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b2c96a99-eaff-4c60-bb5e-616c30cf5481 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:40.143561 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b2c96a99-eaff-4c60-bb5e-616c30cf5481 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:40.284344 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b2c96a99-eaff-4c60-bb5e-616c30cf5481 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:40.293197 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b2c96a99-eaff-4c60-bb5e-616c30cf5481 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1672 microversion: 2.1 time: 0.162163 May 23 15:36:40.293782 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 429/841] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:40 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:36:40.699414 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-58464b67-caf8-4cb0-b3c4-2de67df58c92 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:40.700103 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-58464b67-caf8-4cb0-b3c4-2de67df58c92 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:40.706919 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58464b67-caf8-4cb0-b3c4-2de67df58c92 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:40.707379 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58464b67-caf8-4cb0-b3c4-2de67df58c92 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:40.708177 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58464b67-caf8-4cb0-b3c4-2de67df58c92 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:40.708629 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-58464b67-caf8-4cb0-b3c4-2de67df58c92 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:40.834575 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-58464b67-caf8-4cb0-b3c4-2de67df58c92 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:40.842142 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-58464b67-caf8-4cb0-b3c4-2de67df58c92 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 200 len: 1680 microversion: 2.1 time: 0.146719 May 23 15:36:40.842711 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 413/842] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:40 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:36:41.311307 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-352e3f77-f789-44d2-9104-678a0fa32a81 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:41.311924 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-352e3f77-f789-44d2-9104-678a0fa32a81 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:41.318693 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-352e3f77-f789-44d2-9104-678a0fa32a81 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:41.319151 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-352e3f77-f789-44d2-9104-678a0fa32a81 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:41.319959 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-352e3f77-f789-44d2-9104-678a0fa32a81 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:41.320402 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-352e3f77-f789-44d2-9104-678a0fa32a81 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:41.450655 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-352e3f77-f789-44d2-9104-678a0fa32a81 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:41.460162 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-352e3f77-f789-44d2-9104-678a0fa32a81 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1672 microversion: 2.1 time: 0.152775 May 23 15:36:41.460739 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 430/843] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:41 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:36:41.860299 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-0d4845e7-1a04-44c0-863f-ac6c2ece6560 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:41.862051 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-0d4845e7-1a04-44c0-863f-ac6c2ece6560 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:41.869315 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0d4845e7-1a04-44c0-863f-ac6c2ece6560 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:41.869814 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0d4845e7-1a04-44c0-863f-ac6c2ece6560 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:41.870599 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0d4845e7-1a04-44c0-863f-ac6c2ece6560 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:41.871047 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0d4845e7-1a04-44c0-863f-ac6c2ece6560 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:41.998145 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-0d4845e7-1a04-44c0-863f-ac6c2ece6560 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:42.006409 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-0d4845e7-1a04-44c0-863f-ac6c2ece6560 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 200 len: 1680 microversion: 2.1 time: 0.150478 May 23 15:36:42.006981 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 414/844] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:41 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:36:42.477513 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-13df6db1-f36f-4453-92d9-feb1f61d8c7f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:42.478471 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-13df6db1-f36f-4453-92d9-feb1f61d8c7f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:42.485703 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-13df6db1-f36f-4453-92d9-feb1f61d8c7f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:42.487044 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-13df6db1-f36f-4453-92d9-feb1f61d8c7f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:42.488022 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-13df6db1-f36f-4453-92d9-feb1f61d8c7f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:42.488611 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-13df6db1-f36f-4453-92d9-feb1f61d8c7f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:42.695403 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-13df6db1-f36f-4453-92d9-feb1f61d8c7f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:42.707516 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-13df6db1-f36f-4453-92d9-feb1f61d8c7f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1672 microversion: 2.1 time: 0.233748 May 23 15:36:42.721556 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 431/845] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:42 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1672 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:36:43.025910 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b9b4f55f-acfc-4aec-acba-cc5d5dd8ea6f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:43.026715 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b9b4f55f-acfc-4aec-acba-cc5d5dd8ea6f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:43.029328 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:43.036777 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b9b4f55f-acfc-4aec-acba-cc5d5dd8ea6f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:43.037402 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b9b4f55f-acfc-4aec-acba-cc5d5dd8ea6f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:43.038307 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b9b4f55f-acfc-4aec-acba-cc5d5dd8ea6f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:43.038881 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b9b4f55f-acfc-4aec-acba-cc5d5dd8ea6f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:43.157301 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-63b1d65f-1325-4f59-9cb9-cb22d28170f8 req-d3874b29-0309-4eaf-9364-aaa3fcee11a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb5b773-cad7-4825-8550-efc0cebf77ac", "name": "network-vif-deleted", "tag": "9da9d834-ba1e-4927-8127-fb201067194c"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:36:43.169517 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-63b1d65f-1325-4f59-9cb9-cb22d28170f8 req-d3874b29-0309-4eaf-9364-aaa3fcee11a9 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:43.170417 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-63b1d65f-1325-4f59-9cb9-cb22d28170f8 req-d3874b29-0309-4eaf-9364-aaa3fcee11a9 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:43.186082 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-63b1d65f-1325-4f59-9cb9-cb22d28170f8 req-d3874b29-0309-4eaf-9364-aaa3fcee11a9 service nova] Creating event network-vif-deleted:9da9d834-ba1e-4927-8127-fb201067194c for instance 7cb5b773-cad7-4825-8550-efc0cebf77ac on hv-cinder-84112 May 23 15:36:43.189551 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b9b4f55f-acfc-4aec-acba-cc5d5dd8ea6f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06431315dc8040cbbafbe83a3ed8e0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2020e2bf35744af9161d7cf3e8bd345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:43.193586 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-63b1d65f-1325-4f59-9cb9-cb22d28170f8 req-d3874b29-0309-4eaf-9364-aaa3fcee11a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040701 May 23 15:36:43.194632 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 432/846] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:36:43.199189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b9b4f55f-acfc-4aec-acba-cc5d5dd8ea6f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 200 len: 1614 microversion: 2.1 time: 0.178370 May 23 15:36:43.224742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 415/847] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:43 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 1614 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:36:43.740657 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1dc5cd82-d0d1-495a-b0a5-6e3c4dba143f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:43.743765 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-1dc5cd82-d0d1-495a-b0a5-6e3c4dba143f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:43.758840 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1dc5cd82-d0d1-495a-b0a5-6e3c4dba143f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:43.760590 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1dc5cd82-d0d1-495a-b0a5-6e3c4dba143f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:43.763119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1dc5cd82-d0d1-495a-b0a5-6e3c4dba143f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:43.765100 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1dc5cd82-d0d1-495a-b0a5-6e3c4dba143f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:43.839308 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-27c32f97-d335-44be-ac01-44ec7c3fcd4d req-8dfcf064-a08a-4ba5-ad72-3425bbae758b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b2fc89f-88e8-42b3-9006-35470a9f74fc", "name": "network-vif-deleted", "tag": "7781bf30-5eb4-4474-84ee-26a19cdd971e"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:36:43.851127 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-27c32f97-d335-44be-ac01-44ec7c3fcd4d req-8dfcf064-a08a-4ba5-ad72-3425bbae758b service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:43.852014 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-27c32f97-d335-44be-ac01-44ec7c3fcd4d req-8dfcf064-a08a-4ba5-ad72-3425bbae758b service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:43.900332 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-27c32f97-d335-44be-ac01-44ec7c3fcd4d req-8dfcf064-a08a-4ba5-ad72-3425bbae758b service nova] Creating event network-vif-deleted:7781bf30-5eb4-4474-84ee-26a19cdd971e for instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc on hv-cinder-84112 May 23 15:36:43.910553 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-27c32f97-d335-44be-ac01-44ec7c3fcd4d req-8dfcf064-a08a-4ba5-ad72-3425bbae758b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299128 May 23 15:36:43.930252 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 433/848] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:36:43.962539 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-1dc5cd82-d0d1-495a-b0a5-6e3c4dba143f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ae34a029c14c6f826456414ac0670d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aaff9db173d4618929536b08d2be8f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:43.973596 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1dc5cd82-d0d1-495a-b0a5-6e3c4dba143f tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 200 len: 1323 microversion: 2.1 time: 0.243489 May 23 15:36:43.983418 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 416/849] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:43 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 1323 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:36:44.226651 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c87c98d6-7d4b-47e0-a2aa-06327474a945 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:44.228580 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-c87c98d6-7d4b-47e0-a2aa-06327474a945 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:44.250400 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c87c98d6-7d4b-47e0-a2aa-06327474a945 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:44.253023 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c87c98d6-7d4b-47e0-a2aa-06327474a945 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:44.254148 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c87c98d6-7d4b-47e0-a2aa-06327474a945 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:44.256924 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c87c98d6-7d4b-47e0-a2aa-06327474a945 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:44.289677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-c87c98d6-7d4b-47e0-a2aa-06327474a945 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] HTTP exception thrown: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c87c98d6-7d4b-47e0-a2aa-06327474a945 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Request method failure captured: May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac HTTP/1.1 May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6h_2ReNrnx1JyF_czjkEAP1FuuKwobsqEvhvInfqaSMw40CgNqIWA8A_vk7tsr0FV_LD0bCmm_eDbjudzYvptuB3YHMpvf76_Q9bPzPUDO6TB58uh-JSMbCrz2YGnMhaGsyJsPiGIuEP-UECWBwo39-BQHYqnkGew60A4fcmeNHaS8 May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:36:44.294356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:36:44.295957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2020e2bf35744af9161d7cf3e8bd345", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:36:44.295957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:44.295957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:44.295957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:44.295957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:44.295957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:36:44.295957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:36:44.295957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 06431315dc8040cbbafbe83a3ed8e0e4 May 23 15:36:44.295957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:44.295957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:36:44.295957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. May 23 15:36:44.295957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '7cb5b773-cad7-4825-8550-efc0cebf77ac'} May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:36:44.296981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. May 23 15:36:44.298594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:44.300793 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c87c98d6-7d4b-47e0-a2aa-06327474a945 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Returning 404 to user: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:36:44.302132 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-c87c98d6-7d4b-47e0-a2aa-06327474a945 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 404 len: 111 microversion: 2.1 time: 0.081807 May 23 15:36:44.302870 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 434/850] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:44 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:36:44.319530 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-bf081ffe-3d66-4684-aea7-9b882df77b91 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '.version_select at 0x7f0d7a449790>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:44.345892 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-bf081ffe-3d66-4684-aea7-9b882df77b91 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061153375" status: 202 len: 0 microversion: 2.1 time: 0.036536 May 23 15:36:44.347401 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 417/851] 10.222.0.30 () {58 vars in 1220 bytes} [Mon May 23 15:36:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061153375 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:36:44.991373 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-62546f69-ba9a-43b2-a475-4fc9d3ab41e1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:44.991989 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-62546f69-ba9a-43b2-a475-4fc9d3ab41e1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:44.996050 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=46 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:45.011445 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-62546f69-ba9a-43b2-a475-4fc9d3ab41e1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:45.012444 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-62546f69-ba9a-43b2-a475-4fc9d3ab41e1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:45.013386 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-62546f69-ba9a-43b2-a475-4fc9d3ab41e1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:45.014318 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-62546f69-ba9a-43b2-a475-4fc9d3ab41e1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:45.032756 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-62546f69-ba9a-43b2-a475-4fc9d3ab41e1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] HTTP exception thrown: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-62546f69-ba9a-43b2-a475-4fc9d3ab41e1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Request method failure captured: May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc HTTP/1.1 May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6iFP0TGBa2hDfXSS6FqwwJRnPWaLet6Ntjd-Lq3B8RNMryejuq1rkw52mSjm1q_At_4C3FIqdmchkYRj-zSXrOvsMvOqmww91oAYQtQtJzMAmqnUHFP8L3FFt1Uor15UonjhBOFMTpLJodG6S0rbyouSgz4C7jNygN7x2Yx3x-IS2s May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 9aaff9db173d4618929536b08d2be8f0 May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-AttachVolumeTestJSON-1837964167 May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:36:45.034352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:36:45.035840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9aaff9db173d4618929536b08d2be8f0", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:36:45.035840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-AttachVolumeTestJSON-1837964167 May 23 15:36:45.035840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 9aaff9db173d4618929536b08d2be8f0 May 23 15:36:45.035840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1837964167 May 23 15:36:45.035840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-AttachVolumeTestJSON-1837964167-project May 23 15:36:45.035840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:36:45.035840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:36:45.035840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: d0ae34a029c14c6f826456414ac0670d May 23 15:36:45.035840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-AttachVolumeTestJSON-1837964167-project May 23 15:36:45.035840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:36:45.035840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. May 23 15:36:45.035840 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '2b2fc89f-88e8-42b3-9006-35470a9f74fc'} May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:36:45.036539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. May 23 15:36:45.038612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:45.041178 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-62546f69-ba9a-43b2-a475-4fc9d3ab41e1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Returning 404 to user: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:36:45.041178 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-62546f69-ba9a-43b2-a475-4fc9d3ab41e1 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 404 len: 111 microversion: 2.1 time: 0.049110 May 23 15:36:45.041178 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 435/852] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:44 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:36:45.046397 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8a951385-c2b3-43c2-8b4c-2319cbd09d3e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '.version_select at 0x7f0d7a46e310>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:45.070971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8a951385-c2b3-43c2-8b4c-2319cbd09d3e tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425277546" status: 202 len: 0 microversion: 2.1 time: 0.028145 May 23 15:36:45.071902 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 418/853] 10.222.0.30 () {58 vars in 1220 bytes} [Mon May 23 15:36:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425277546 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:36:46.319706 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c710052d-10ee-4d33-a5bd-7b08771623ff tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:46.320226 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-c710052d-10ee-4d33-a5bd-7b08771623ff tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:46.326675 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c710052d-10ee-4d33-a5bd-7b08771623ff tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:46.327133 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c710052d-10ee-4d33-a5bd-7b08771623ff tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:46.327903 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c710052d-10ee-4d33-a5bd-7b08771623ff tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:46.328342 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c710052d-10ee-4d33-a5bd-7b08771623ff tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:46.342479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-c710052d-10ee-4d33-a5bd-7b08771623ff tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] HTTP exception thrown: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c710052d-10ee-4d33-a5bd-7b08771623ff tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Request method failure captured: May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: DELETE /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac HTTP/1.1 May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6h_2ReNrnx1JyF_czjkEAP1FuuKwobsqEvhvInfqaSMw40CgNqIWA8A_vk7tsr0FV_LD0bCmm_eDbjudzYvptuB3YHMpvf76_Q9bPzPUDO6TB58uh-JSMbCrz2YGnMhaGsyJsPiGIuEP-UECWBwo39-BQHYqnkGew60A4fcmeNHaS8 May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:36:46.344065 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:36:46.345937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2020e2bf35744af9161d7cf3e8bd345", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:36:46.345937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:46.345937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:46.345937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:46.345937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:46.345937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:36:46.345937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:36:46.345937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 06431315dc8040cbbafbe83a3ed8e0e4 May 23 15:36:46.345937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:46.345937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:36:46.345937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. May 23 15:36:46.345937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '7cb5b773-cad7-4825-8550-efc0cebf77ac'} May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:36:46.346958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. May 23 15:36:46.348394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:46.349718 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c710052d-10ee-4d33-a5bd-7b08771623ff tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Returning 404 to user: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:36:46.349718 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-c710052d-10ee-4d33-a5bd-7b08771623ff tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 404 len: 111 microversion: 2.1 time: 0.029633 May 23 15:36:46.349718 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 436/854] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:36:46 2022] DELETE /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:36:46.354506 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-691b003e-0cb5-4e6f-a666-ba867921915f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:46.355129 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-691b003e-0cb5-4e6f-a666-ba867921915f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 7cb5b773-cad7-4825-8550-efc0cebf77ac] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:46.362555 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-691b003e-0cb5-4e6f-a666-ba867921915f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:46.363005 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-691b003e-0cb5-4e6f-a666-ba867921915f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:46.363770 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-691b003e-0cb5-4e6f-a666-ba867921915f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:46.364206 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-691b003e-0cb5-4e6f-a666-ba867921915f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:46.377586 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-691b003e-0cb5-4e6f-a666-ba867921915f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] HTTP exception thrown: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-691b003e-0cb5-4e6f-a666-ba867921915f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Request method failure captured: May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac HTTP/1.1 May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6h_2ReNrnx1JyF_czjkEAP1FuuKwobsqEvhvInfqaSMw40CgNqIWA8A_vk7tsr0FV_LD0bCmm_eDbjudzYvptuB3YHMpvf76_Q9bPzPUDO6TB58uh-JSMbCrz2YGnMhaGsyJsPiGIuEP-UECWBwo39-BQHYqnkGew60A4fcmeNHaS8 May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:36:46.379237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:36:46.380852 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2020e2bf35744af9161d7cf3e8bd345", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:36:46.380852 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:46.380852 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:46.380852 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:46.380852 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:46.380852 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:36:46.380852 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:36:46.380852 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: 06431315dc8040cbbafbe83a3ed8e0e4 May 23 15:36:46.380852 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:46.380852 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:36:46.380852 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. May 23 15:36:46.380852 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': '7cb5b773-cad7-4825-8550-efc0cebf77ac'} May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:36:46.384696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. May 23 15:36:46.386170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:46.387531 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-691b003e-0cb5-4e6f-a666-ba867921915f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Returning 404 to user: Instance 7cb5b773-cad7-4825-8550-efc0cebf77ac could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:36:46.387531 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-691b003e-0cb5-4e6f-a666-ba867921915f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac" status: 404 len: 111 microversion: 2.1 time: 0.030532 May 23 15:36:46.387531 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 419/855] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:46 2022] GET /compute/v2.1/servers/7cb5b773-cad7-4825-8550-efc0cebf77ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:36:47.520580 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2323ea18-c889-476e-b0ec-fd578a6bc168 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:47.521116 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-2323ea18-c889-476e-b0ec-fd578a6bc168 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:47.527786 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2323ea18-c889-476e-b0ec-fd578a6bc168 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:47.528254 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2323ea18-c889-476e-b0ec-fd578a6bc168 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:47.529042 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2323ea18-c889-476e-b0ec-fd578a6bc168 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:47.529470 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2323ea18-c889-476e-b0ec-fd578a6bc168 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:47.543347 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-2323ea18-c889-476e-b0ec-fd578a6bc168 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] HTTP exception thrown: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2323ea18-c889-476e-b0ec-fd578a6bc168 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Request method failure captured: May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: DELETE /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 HTTP/1.1 May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6h_2ReNrnx1JyF_czjkEAP1FuuKwobsqEvhvInfqaSMw40CgNqIWA8A_vk7tsr0FV_LD0bCmm_eDbjudzYvptuB3YHMpvf76_Q9bPzPUDO6TB58uh-JSMbCrz2YGnMhaGsyJsPiGIuEP-UECWBwo39-BQHYqnkGew60A4fcmeNHaS8 May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:36:47.544916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:36:47.546455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2020e2bf35744af9161d7cf3e8bd345", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:36:47.546455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:47.546455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:47.546455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:47.546455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:47.546455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:36:47.546455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:36:47.546455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 06431315dc8040cbbafbe83a3ed8e0e4 May 23 15:36:47.546455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:47.546455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:36:47.546455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. May 23 15:36:47.546455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '1742ffd2-9b97-445d-94ad-da23deebac48'} May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:36:47.547370 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. May 23 15:36:47.549757 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:47.551455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2323ea18-c889-476e-b0ec-fd578a6bc168 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Returning 404 to user: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:36:47.551455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-2323ea18-c889-476e-b0ec-fd578a6bc168 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 404 len: 111 microversion: 2.1 time: 0.029618 May 23 15:36:47.551455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 437/856] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:36:47 2022] DELETE /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:36:47.556186 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3236e86e-57c5-4249-b168-59b6d9c85f3c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:47.556812 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-3236e86e-57c5-4249-b168-59b6d9c85f3c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: 1742ffd2-9b97-445d-94ad-da23deebac48] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:47.563465 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3236e86e-57c5-4249-b168-59b6d9c85f3c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:47.563934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3236e86e-57c5-4249-b168-59b6d9c85f3c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:47.564860 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3236e86e-57c5-4249-b168-59b6d9c85f3c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:47.565334 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3236e86e-57c5-4249-b168-59b6d9c85f3c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:47.578278 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-3236e86e-57c5-4249-b168-59b6d9c85f3c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] HTTP exception thrown: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3236e86e-57c5-4249-b168-59b6d9c85f3c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Request method failure captured: May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 HTTP/1.1 May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6h_2ReNrnx1JyF_czjkEAP1FuuKwobsqEvhvInfqaSMw40CgNqIWA8A_vk7tsr0FV_LD0bCmm_eDbjudzYvptuB3YHMpvf76_Q9bPzPUDO6TB58uh-JSMbCrz2YGnMhaGsyJsPiGIuEP-UECWBwo39-BQHYqnkGew60A4fcmeNHaS8 May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:36:47.579871 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:36:47.581475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2020e2bf35744af9161d7cf3e8bd345", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:36:47.581475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:47.581475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:47.581475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:47.581475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:47.581475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:36:47.581475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:36:47.581475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: 06431315dc8040cbbafbe83a3ed8e0e4 May 23 15:36:47.581475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:47.581475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:36:47.581475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. May 23 15:36:47.581475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': '1742ffd2-9b97-445d-94ad-da23deebac48'} May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:36:47.582415 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. May 23 15:36:47.583781 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:47.585396 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3236e86e-57c5-4249-b168-59b6d9c85f3c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Returning 404 to user: Instance 1742ffd2-9b97-445d-94ad-da23deebac48 could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:36:47.585396 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-3236e86e-57c5-4249-b168-59b6d9c85f3c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48" status: 404 len: 111 microversion: 2.1 time: 0.029133 May 23 15:36:47.585396 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 420/857] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:47 2022] GET /compute/v2.1/servers/1742ffd2-9b97-445d-94ad-da23deebac48 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:36:47.592956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c792e1ff-29bb-4ee1-876f-569b73ce9f76 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:47.592956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-c792e1ff-29bb-4ee1-876f-569b73ce9f76 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:47.597590 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c792e1ff-29bb-4ee1-876f-569b73ce9f76 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:47.598020 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c792e1ff-29bb-4ee1-876f-569b73ce9f76 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:47.598783 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c792e1ff-29bb-4ee1-876f-569b73ce9f76 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:47.599209 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c792e1ff-29bb-4ee1-876f-569b73ce9f76 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:47.614556 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-c792e1ff-29bb-4ee1-876f-569b73ce9f76 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] HTTP exception thrown: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c792e1ff-29bb-4ee1-876f-569b73ce9f76 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Request method failure captured: May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: DELETE /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 HTTP/1.1 May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6h_2ReNrnx1JyF_czjkEAP1FuuKwobsqEvhvInfqaSMw40CgNqIWA8A_vk7tsr0FV_LD0bCmm_eDbjudzYvptuB3YHMpvf76_Q9bPzPUDO6TB58uh-JSMbCrz2YGnMhaGsyJsPiGIuEP-UECWBwo39-BQHYqnkGew60A4fcmeNHaS8 May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:36:47.616117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:36:47.617479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2020e2bf35744af9161d7cf3e8bd345", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:36:47.617479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:47.617479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:47.617479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:47.617479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:47.617479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:36:47.617479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:36:47.617479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 06431315dc8040cbbafbe83a3ed8e0e4 May 23 15:36:47.617479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:47.617479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:36:47.617479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. May 23 15:36:47.617479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': 'cc0f4046-cea9-4426-9970-4ff8f307a3c0'} May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:36:47.618496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. May 23 15:36:47.619677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:47.620838 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c792e1ff-29bb-4ee1-876f-569b73ce9f76 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Returning 404 to user: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:36:47.620838 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-c792e1ff-29bb-4ee1-876f-569b73ce9f76 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 404 len: 111 microversion: 2.1 time: 0.031384 May 23 15:36:47.620838 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 438/858] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:36:47 2022] DELETE /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:36:47.626199 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-434591a8-15be-46b0-8152-7d8b544e8c2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:47.626884 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-434591a8-15be-46b0-8152-7d8b544e8c2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: cc0f4046-cea9-4426-9970-4ff8f307a3c0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:47.632974 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-434591a8-15be-46b0-8152-7d8b544e8c2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:47.633356 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-434591a8-15be-46b0-8152-7d8b544e8c2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:47.634122 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-434591a8-15be-46b0-8152-7d8b544e8c2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:47.634571 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-434591a8-15be-46b0-8152-7d8b544e8c2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:47.654208 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-434591a8-15be-46b0-8152-7d8b544e8c2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] HTTP exception thrown: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-434591a8-15be-46b0-8152-7d8b544e8c2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Request method failure captured: May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 HTTP/1.1 May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6h_2ReNrnx1JyF_czjkEAP1FuuKwobsqEvhvInfqaSMw40CgNqIWA8A_vk7tsr0FV_LD0bCmm_eDbjudzYvptuB3YHMpvf76_Q9bPzPUDO6TB58uh-JSMbCrz2YGnMhaGsyJsPiGIuEP-UECWBwo39-BQHYqnkGew60A4fcmeNHaS8 May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:36:47.655794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:36:47.657359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2020e2bf35744af9161d7cf3e8bd345", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:36:47.657359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:47.657359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:47.657359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:47.657359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:47.657359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:36:47.657359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:36:47.657359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: 06431315dc8040cbbafbe83a3ed8e0e4 May 23 15:36:47.657359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:47.657359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:36:47.657359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. May 23 15:36:47.657359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': 'cc0f4046-cea9-4426-9970-4ff8f307a3c0'} May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:36:47.658606 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. May 23 15:36:47.659756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:47.660807 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-434591a8-15be-46b0-8152-7d8b544e8c2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Returning 404 to user: Instance cc0f4046-cea9-4426-9970-4ff8f307a3c0 could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:36:47.660807 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-434591a8-15be-46b0-8152-7d8b544e8c2f tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0" status: 404 len: 111 microversion: 2.1 time: 0.034937 May 23 15:36:47.660807 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 421/859] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:47 2022] GET /compute/v2.1/servers/cc0f4046-cea9-4426-9970-4ff8f307a3c0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:36:47.999454 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-765311b4-9178-45fa-8794-e7a39dbc8511 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:47.999947 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-765311b4-9178-45fa-8794-e7a39dbc8511 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:48.007257 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-765311b4-9178-45fa-8794-e7a39dbc8511 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:48.007874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-765311b4-9178-45fa-8794-e7a39dbc8511 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:48.008820 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-765311b4-9178-45fa-8794-e7a39dbc8511 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:48.009516 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-765311b4-9178-45fa-8794-e7a39dbc8511 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:48.023112 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-765311b4-9178-45fa-8794-e7a39dbc8511 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] HTTP exception thrown: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-765311b4-9178-45fa-8794-e7a39dbc8511 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Request method failure captured: May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: DELETE /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc HTTP/1.1 May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6iFP0TGBa2hDfXSS6FqwwJRnPWaLet6Ntjd-Lq3B8RNMryejuq1rkw52mSjm1q_At_4C3FIqdmchkYRj-zSXrOvsMvOqmww91oAYQtQtJzMAmqnUHFP8L3FFt1Uor15UonjhBOFMTpLJodG6S0rbyouSgz4C7jNygN7x2Yx3x-IS2s May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 9aaff9db173d4618929536b08d2be8f0 May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-AttachVolumeTestJSON-1837964167 May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:36:48.024931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:36:48.026514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9aaff9db173d4618929536b08d2be8f0", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:36:48.026514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-AttachVolumeTestJSON-1837964167 May 23 15:36:48.026514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 9aaff9db173d4618929536b08d2be8f0 May 23 15:36:48.026514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1837964167 May 23 15:36:48.026514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-AttachVolumeTestJSON-1837964167-project May 23 15:36:48.026514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:36:48.026514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:36:48.026514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: d0ae34a029c14c6f826456414ac0670d May 23 15:36:48.026514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-AttachVolumeTestJSON-1837964167-project May 23 15:36:48.026514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:36:48.026514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. May 23 15:36:48.026514 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '2b2fc89f-88e8-42b3-9006-35470a9f74fc'} May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:36:48.027366 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. May 23 15:36:48.028809 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:48.030337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-765311b4-9178-45fa-8794-e7a39dbc8511 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Returning 404 to user: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:36:48.030337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-765311b4-9178-45fa-8794-e7a39dbc8511 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 404 len: 111 microversion: 2.1 time: 0.030774 May 23 15:36:48.030337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 439/860] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:36:47 2022] DELETE /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:36:48.035322 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-01aa87d8-5821-4a6b-8972-d6d6a49af78d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:48.035950 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-01aa87d8-5821-4a6b-8972-d6d6a49af78d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 2b2fc89f-88e8-42b3-9006-35470a9f74fc] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:48.041988 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-01aa87d8-5821-4a6b-8972-d6d6a49af78d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:48.042450 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-01aa87d8-5821-4a6b-8972-d6d6a49af78d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:48.043220 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-01aa87d8-5821-4a6b-8972-d6d6a49af78d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:48.043667 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-01aa87d8-5821-4a6b-8972-d6d6a49af78d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:48.060510 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-01aa87d8-5821-4a6b-8972-d6d6a49af78d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] HTTP exception thrown: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-01aa87d8-5821-4a6b-8972-d6d6a49af78d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Request method failure captured: May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc HTTP/1.1 May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6iFP0TGBa2hDfXSS6FqwwJRnPWaLet6Ntjd-Lq3B8RNMryejuq1rkw52mSjm1q_At_4C3FIqdmchkYRj-zSXrOvsMvOqmww91oAYQtQtJzMAmqnUHFP8L3FFt1Uor15UonjhBOFMTpLJodG6S0rbyouSgz4C7jNygN7x2Yx3x-IS2s May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: 9aaff9db173d4618929536b08d2be8f0 May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-AttachVolumeTestJSON-1837964167 May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:36:48.062088 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:36:48.063601 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9aaff9db173d4618929536b08d2be8f0", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:36:48.063601 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-AttachVolumeTestJSON-1837964167 May 23 15:36:48.063601 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: 9aaff9db173d4618929536b08d2be8f0 May 23 15:36:48.063601 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1837964167 May 23 15:36:48.063601 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-AttachVolumeTestJSON-1837964167-project May 23 15:36:48.063601 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:36:48.063601 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:36:48.063601 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: d0ae34a029c14c6f826456414ac0670d May 23 15:36:48.063601 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-AttachVolumeTestJSON-1837964167-project May 23 15:36:48.063601 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:36:48.063601 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. May 23 15:36:48.063601 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': '2b2fc89f-88e8-42b3-9006-35470a9f74fc'} May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:36:48.068329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. May 23 15:36:48.069819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:48.071082 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-01aa87d8-5821-4a6b-8972-d6d6a49af78d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Returning 404 to user: Instance 2b2fc89f-88e8-42b3-9006-35470a9f74fc could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:36:48.071082 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-01aa87d8-5821-4a6b-8972-d6d6a49af78d tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc" status: 404 len: 111 microversion: 2.1 time: 0.032637 May 23 15:36:48.071082 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 422/861] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:48 2022] GET /compute/v2.1/servers/2b2fc89f-88e8-42b3-9006-35470a9f74fc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:36:48.796564 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e4e1957a-0fab-45a6-80fc-fc7aaf58ccd3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:48.797132 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e4e1957a-0fab-45a6-80fc-fc7aaf58ccd3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:48.803619 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e4e1957a-0fab-45a6-80fc-fc7aaf58ccd3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:48.804068 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e4e1957a-0fab-45a6-80fc-fc7aaf58ccd3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:48.804827 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e4e1957a-0fab-45a6-80fc-fc7aaf58ccd3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:48.805291 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e4e1957a-0fab-45a6-80fc-fc7aaf58ccd3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:48.821297 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-e4e1957a-0fab-45a6-80fc-fc7aaf58ccd3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] HTTP exception thrown: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e4e1957a-0fab-45a6-80fc-fc7aaf58ccd3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Request method failure captured: May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: DELETE /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e HTTP/1.1 May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6h_2ReNrnx1JyF_czjkEAP1FuuKwobsqEvhvInfqaSMw40CgNqIWA8A_vk7tsr0FV_LD0bCmm_eDbjudzYvptuB3YHMpvf76_Q9bPzPUDO6TB58uh-JSMbCrz2YGnMhaGsyJsPiGIuEP-UECWBwo39-BQHYqnkGew60A4fcmeNHaS8 May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:36:48.823441 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:36:48.825033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2020e2bf35744af9161d7cf3e8bd345", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:36:48.825033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:48.825033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:48.825033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:48.825033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:48.825033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:36:48.825033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:36:48.825033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 06431315dc8040cbbafbe83a3ed8e0e4 May 23 15:36:48.825033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:48.825033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:36:48.825033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. May 23 15:36:48.825033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': 'e30f7223-50a4-46a7-b9df-cc24cc0ba14e'} May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:36:48.828802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. May 23 15:36:48.830981 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:48.832478 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e4e1957a-0fab-45a6-80fc-fc7aaf58ccd3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Returning 404 to user: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:36:48.832478 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e4e1957a-0fab-45a6-80fc-fc7aaf58ccd3 tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 404 len: 111 microversion: 2.1 time: 0.032429 May 23 15:36:48.832478 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 440/862] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:36:48 2022] DELETE /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:36:48.838989 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ee524b69-e15a-4c37-ae93-a92c37b88a9c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:48.839620 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ee524b69-e15a-4c37-ae93-a92c37b88a9c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] [instance: e30f7223-50a4-46a7-b9df-cc24cc0ba14e] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:48.847045 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ee524b69-e15a-4c37-ae93-a92c37b88a9c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:48.847529 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ee524b69-e15a-4c37-ae93-a92c37b88a9c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:48.848510 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ee524b69-e15a-4c37-ae93-a92c37b88a9c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:48.848728 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ee524b69-e15a-4c37-ae93-a92c37b88a9c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:48.862618 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-ee524b69-e15a-4c37-ae93-a92c37b88a9c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] HTTP exception thrown: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ee524b69-e15a-4c37-ae93-a92c37b88a9c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Request method failure captured: May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e HTTP/1.1 May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6h_2ReNrnx1JyF_czjkEAP1FuuKwobsqEvhvInfqaSMw40CgNqIWA8A_vk7tsr0FV_LD0bCmm_eDbjudzYvptuB3YHMpvf76_Q9bPzPUDO6TB58uh-JSMbCrz2YGnMhaGsyJsPiGIuEP-UECWBwo39-BQHYqnkGew60A4fcmeNHaS8 May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:36:48.864183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:36:48.865772 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2020e2bf35744af9161d7cf3e8bd345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2020e2bf35744af9161d7cf3e8bd345", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:36:48.865772 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:48.865772 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: f2020e2bf35744af9161d7cf3e8bd345 May 23 15:36:48.865772 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1222060410 May 23 15:36:48.865772 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:48.865772 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:36:48.865772 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:36:48.865772 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: 06431315dc8040cbbafbe83a3ed8e0e4 May 23 15:36:48.865772 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-AttachVolumeNegativeTest-1222060410-project May 23 15:36:48.865772 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:36:48.865772 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. May 23 15:36:48.865772 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': 'e30f7223-50a4-46a7-b9df-cc24cc0ba14e'} May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:36:48.866570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. May 23 15:36:48.867968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:48.869400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ee524b69-e15a-4c37-ae93-a92c37b88a9c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] Returning 404 to user: Instance e30f7223-50a4-46a7-b9df-cc24cc0ba14e could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:36:48.869400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ee524b69-e15a-4c37-ae93-a92c37b88a9c tempest-AttachVolumeNegativeTest-1222060410 tempest-AttachVolumeNegativeTest-1222060410-project] 10.222.0.30 "GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e" status: 404 len: 111 microversion: 2.1 time: 0.030611 May 23 15:36:48.869400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 423/863] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:48 2022] GET /compute/v2.1/servers/e30f7223-50a4-46a7-b9df-cc24cc0ba14e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:36:49.206619 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2354e117-4d25-404f-b3d4-a8eb3fde6b17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:49.207116 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-2354e117-4d25-404f-b3d4-a8eb3fde6b17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:49.213617 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2354e117-4d25-404f-b3d4-a8eb3fde6b17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:49.214205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2354e117-4d25-404f-b3d4-a8eb3fde6b17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:49.215194 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2354e117-4d25-404f-b3d4-a8eb3fde6b17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:49.215854 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2354e117-4d25-404f-b3d4-a8eb3fde6b17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:49.243265 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-2354e117-4d25-404f-b3d4-a8eb3fde6b17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] HTTP exception thrown: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2354e117-4d25-404f-b3d4-a8eb3fde6b17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Request method failure captured: May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: DELETE /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 HTTP/1.1 May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6iFP0TGBa2hDfXSS6FqwwJRnPWaLet6Ntjd-Lq3B8RNMryejuq1rkw52mSjm1q_At_4C3FIqdmchkYRj-zSXrOvsMvOqmww91oAYQtQtJzMAmqnUHFP8L3FFt1Uor15UonjhBOFMTpLJodG6S0rbyouSgz4C7jNygN7x2Yx3x-IS2s May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 9aaff9db173d4618929536b08d2be8f0 May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-AttachVolumeTestJSON-1837964167 May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:36:49.245171 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:36:49.246631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9aaff9db173d4618929536b08d2be8f0", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:36:49.246631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-AttachVolumeTestJSON-1837964167 May 23 15:36:49.246631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 9aaff9db173d4618929536b08d2be8f0 May 23 15:36:49.246631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1837964167 May 23 15:36:49.246631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-AttachVolumeTestJSON-1837964167-project May 23 15:36:49.246631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:36:49.246631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:36:49.246631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: d0ae34a029c14c6f826456414ac0670d May 23 15:36:49.246631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-AttachVolumeTestJSON-1837964167-project May 23 15:36:49.246631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:36:49.246631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. May 23 15:36:49.246631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '9e1c71d3-9470-4f72-a76c-e6c114bd4821'} May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:36:49.248054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. May 23 15:36:49.250063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:49.252212 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2354e117-4d25-404f-b3d4-a8eb3fde6b17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Returning 404 to user: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:36:49.252212 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-2354e117-4d25-404f-b3d4-a8eb3fde6b17 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 404 len: 111 microversion: 2.1 time: 0.044463 May 23 15:36:49.252212 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 441/864] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:36:49 2022] DELETE /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:36:49.256076 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c42206f2-068c-4913-9fc3-a5c796714831 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:49.256695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c42206f2-068c-4913-9fc3-a5c796714831 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] [instance: 9e1c71d3-9470-4f72-a76c-e6c114bd4821] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:49.263744 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c42206f2-068c-4913-9fc3-a5c796714831 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:49.264164 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c42206f2-068c-4913-9fc3-a5c796714831 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:49.265066 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c42206f2-068c-4913-9fc3-a5c796714831 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:49.265524 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c42206f2-068c-4913-9fc3-a5c796714831 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:49.282802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-c42206f2-068c-4913-9fc3-a5c796714831 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] HTTP exception thrown: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c42206f2-068c-4913-9fc3-a5c796714831 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Request method failure captured: May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 HTTP/1.1 May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6iFP0TGBa2hDfXSS6FqwwJRnPWaLet6Ntjd-Lq3B8RNMryejuq1rkw52mSjm1q_At_4C3FIqdmchkYRj-zSXrOvsMvOqmww91oAYQtQtJzMAmqnUHFP8L3FFt1Uor15UonjhBOFMTpLJodG6S0rbyouSgz4C7jNygN7x2Yx3x-IS2s May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: 9aaff9db173d4618929536b08d2be8f0 May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-AttachVolumeTestJSON-1837964167 May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:36:49.284378 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:36:49.285932 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9aaff9db173d4618929536b08d2be8f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9aaff9db173d4618929536b08d2be8f0", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:36:49.285932 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-AttachVolumeTestJSON-1837964167 May 23 15:36:49.285932 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: 9aaff9db173d4618929536b08d2be8f0 May 23 15:36:49.285932 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1837964167 May 23 15:36:49.285932 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-AttachVolumeTestJSON-1837964167-project May 23 15:36:49.285932 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:36:49.285932 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:36:49.285932 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: d0ae34a029c14c6f826456414ac0670d May 23 15:36:49.285932 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-AttachVolumeTestJSON-1837964167-project May 23 15:36:49.285932 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:36:49.285932 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. May 23 15:36:49.285932 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': '9e1c71d3-9470-4f72-a76c-e6c114bd4821'} May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:36:49.287119 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. May 23 15:36:49.288648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:36:49.290179 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c42206f2-068c-4913-9fc3-a5c796714831 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] Returning 404 to user: Instance 9e1c71d3-9470-4f72-a76c-e6c114bd4821 could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:36:49.290179 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c42206f2-068c-4913-9fc3-a5c796714831 tempest-AttachVolumeTestJSON-1837964167 tempest-AttachVolumeTestJSON-1837964167-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821" status: 404 len: 111 microversion: 2.1 time: 0.034339 May 23 15:36:49.290179 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 424/865] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:36:49 2022] GET /compute/v2.1/servers/9e1c71d3-9470-4f72-a76c-e6c114bd4821 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:36:55.523628 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-28b5dbdf-c1b2-4017-a895-4cc033172075 tempest-VolumesGetTestJSON-1410495306 tempest-VolumesGetTestJSON-1410495306-project] Action: 'create', calling method: .version_select at 0x7f0d7a3a4040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1482018365", "metadata": {"Type": "work"}}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:36:55.865625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-28b5dbdf-c1b2-4017-a895-4cc033172075 tempest-VolumesGetTestJSON-1410495306 tempest-VolumesGetTestJSON-1410495306-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.578598 May 23 15:36:55.867063 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 442/866] 10.222.0.30 () {60 vars in 1155 bytes} [Mon May 23 15:36:55 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 580 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 15:36:55.878249 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7c8d434b-51c3-48d9-83a6-3cebbdbff8e9 tempest-VolumesGetTestJSON-1410495306 tempest-VolumesGetTestJSON-1410495306-project] Calling method '.version_select at 0x7f0d7a457430>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:55.934260 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7c8d434b-51c3-48d9-83a6-3cebbdbff8e9 tempest-VolumesGetTestJSON-1410495306 tempest-VolumesGetTestJSON-1410495306-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/86651ab4-588c-4070-9a97-d665ce897c2b" status: 200 len: 353 microversion: 2.1 time: 0.060506 May 23 15:36:55.934992 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 425/867] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 15:36:55 2022] GET /compute/v2.1/os-volumes/86651ab4-588c-4070-9a97-d665ce897c2b => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:36:56.949531 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e17d501b-48af-4975-8684-d91e77de16d6 tempest-VolumesGetTestJSON-1410495306 tempest-VolumesGetTestJSON-1410495306-project] Calling method '.version_select at 0x7f0d7a50d4c0>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:57.004155 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e17d501b-48af-4975-8684-d91e77de16d6 tempest-VolumesGetTestJSON-1410495306 tempest-VolumesGetTestJSON-1410495306-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/86651ab4-588c-4070-9a97-d665ce897c2b" status: 200 len: 354 microversion: 2.1 time: 0.060296 May 23 15:36:57.004793 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 443/868] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 15:36:56 2022] GET /compute/v2.1/os-volumes/86651ab4-588c-4070-9a97-d665ce897c2b => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:36:57.018798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-717d60e6-eb34-4c51-a199-efe91213248e tempest-VolumesGetTestJSON-1410495306 tempest-VolumesGetTestJSON-1410495306-project] Calling method '.version_select at 0x7f0d7a59a820>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:57.078679 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-717d60e6-eb34-4c51-a199-efe91213248e tempest-VolumesGetTestJSON-1410495306 tempest-VolumesGetTestJSON-1410495306-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/86651ab4-588c-4070-9a97-d665ce897c2b" status: 200 len: 354 microversion: 2.1 time: 0.065881 May 23 15:36:57.079207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 426/869] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 15:36:57 2022] GET /compute/v2.1/os-volumes/86651ab4-588c-4070-9a97-d665ce897c2b => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:36:57.096622 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e29a614e-4a54-4818-9730-9dd300023f29 tempest-VolumesGetTestJSON-1410495306 tempest-VolumesGetTestJSON-1410495306-project] Calling method '.version_select at 0x7f0d7a50dd30>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:57.171383 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e29a614e-4a54-4818-9730-9dd300023f29 tempest-VolumesGetTestJSON-1410495306 tempest-VolumesGetTestJSON-1410495306-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/86651ab4-588c-4070-9a97-d665ce897c2b" status: 202 len: 0 microversion: 2.1 time: 0.079508 May 23 15:36:57.171998 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 444/870] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 15:36:57 2022] DELETE /compute/v2.1/os-volumes/86651ab4-588c-4070-9a97-d665ce897c2b => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:36:57.181243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-4801cb92-685e-4108-990d-52c040329a1f tempest-VolumesGetTestJSON-1410495306 tempest-VolumesGetTestJSON-1410495306-project] Calling method '.version_select at 0x7f0d7a46e310>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:57.235571 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-4801cb92-685e-4108-990d-52c040329a1f tempest-VolumesGetTestJSON-1410495306 tempest-VolumesGetTestJSON-1410495306-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/86651ab4-588c-4070-9a97-d665ce897c2b" status: 200 len: 353 microversion: 2.1 time: 0.058915 May 23 15:36:57.236258 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 427/871] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 15:36:57 2022] GET /compute/v2.1/os-volumes/86651ab4-588c-4070-9a97-d665ce897c2b => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:36:58.247748 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c591118a-c55a-45bf-a026-0a60c301c8fc tempest-VolumesGetTestJSON-1410495306 tempest-VolumesGetTestJSON-1410495306-project] Calling method '.version_select at 0x7f0d7a50d5e0>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:58.282742 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-c591118a-c55a-45bf-a026-0a60c301c8fc tempest-VolumesGetTestJSON-1410495306 tempest-VolumesGetTestJSON-1410495306-project] HTTP exception thrown: Volume 86651ab4-588c-4070-9a97-d665ce897c2b could not be found. May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c591118a-c55a-45bf-a026-0a60c301c8fc tempest-VolumesGetTestJSON-1410495306 tempest-VolumesGetTestJSON-1410495306-project] Request method failure captured: May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/os-volumes/86651ab4-588c-4070-9a97-d665ce897c2b HTTP/1.1 May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6oXiokptDGbFEj4lwYbRsqLYn6PKQQWQRP6zF0b83IlH09rJy0z9_GXFdh9-vSD3u_nAm1wVUw6IEfuRZ-44PGmGEO5KUeE3UTc-aQNt4mXx48-m-KPXdA8i7-4ychVmPKPRi86vhLg41EonAKzc4YC-vqInW_SJmGS0AlgBtITInE May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 7b5d304bbc7742a5a27808981fd17ad2 May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-VolumesGetTestJSON-1410495306 May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:36:58.285687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:36:58.288029 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7b5d304bbc7742a5a27808981fd17ad2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b5d304bbc7742a5a27808981fd17ad2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b5d304bbc7742a5a27808981fd17ad2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7b5d304bbc7742a5a27808981fd17ad2", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:36:58.288029 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-VolumesGetTestJSON-1410495306 May 23 15:36:58.288029 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 7b5d304bbc7742a5a27808981fd17ad2 May 23 15:36:58.288029 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-VolumesGetTestJSON-1410495306 May 23 15:36:58.288029 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-VolumesGetTestJSON-1410495306-project May 23 15:36:58.288029 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:36:58.288029 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:36:58.288029 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 80870555a9a84101a7fade0e629c0b49 May 23 15:36:58.288029 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-VolumesGetTestJSON-1410495306-project May 23 15:36:58.288029 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: May 23 15:36:58.288029 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Volume 86651ab4-588c-4070-9a97-d665ce897c2b could not be found. May 23 15:36:58.288029 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '86651ab4-588c-4070-9a97-d665ce897c2b'} May 23 15:36:58.288029 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 86651ab4-588c-4070-9a97-d665ce897c2b could not be found. (HTTP 404) (Request-ID: req-bc50410c-95bf-4330-8f4d-2b01b8ed8abb) May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:58.290405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:36:58.292842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 86651ab4-588c-4070-9a97-d665ce897c2b could not be found. May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 15:36:58.295588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:36:58.298417 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 86651ab4-588c-4070-9a97-d665ce897c2b could not be found. May 23 15:36:58.298417 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:58.298417 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:36:58.298417 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:58.298417 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:36:58.298417 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:36:58.298417 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:36:58.298417 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:36:58.298417 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:36:58.298417 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 86651ab4-588c-4070-9a97-d665ce897c2b could not be found. May 23 15:36:58.298417 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:36:58.298417 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c591118a-c55a-45bf-a026-0a60c301c8fc tempest-VolumesGetTestJSON-1410495306 tempest-VolumesGetTestJSON-1410495306-project] Returning 404 to user: Volume 86651ab4-588c-4070-9a97-d665ce897c2b could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:36:58.298417 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-c591118a-c55a-45bf-a026-0a60c301c8fc tempest-VolumesGetTestJSON-1410495306 tempest-VolumesGetTestJSON-1410495306-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/86651ab4-588c-4070-9a97-d665ce897c2b" status: 404 len: 109 microversion: 2.1 time: 0.043244 May 23 15:36:58.298417 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 445/872] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 15:36:58 2022] GET /compute/v2.1/os-volumes/86651ab4-588c-4070-9a97-d665ce897c2b => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:36:59.103578 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ab3e2ad5-78a4-407f-864d-4e1a0fe0c4f5 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:59.104502 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ab3e2ad5-78a4-407f-864d-4e1a0fe0c4f5 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:59.110463 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ab3e2ad5-78a4-407f-864d-4e1a0fe0c4f5 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:59.110950 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ab3e2ad5-78a4-407f-864d-4e1a0fe0c4f5 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:59.112360 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ab3e2ad5-78a4-407f-864d-4e1a0fe0c4f5 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:59.112808 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ab3e2ad5-78a4-407f-864d-4e1a0fe0c4f5 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:59.141520 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ab3e2ad5-78a4-407f-864d-4e1a0fe0c4f5 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042444 May 23 15:36:59.142085 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 428/873] 10.222.0.30 () {60 vars in 1342 bytes} [Mon May 23 15:36:59 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:36:59.207588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f5f1233e-c3bc-41a7-835c-7154a54bd21d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:59.208112 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f5f1233e-c3bc-41a7-835c-7154a54bd21d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:59.215620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f5f1233e-c3bc-41a7-835c-7154a54bd21d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:59.216073 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f5f1233e-c3bc-41a7-835c-7154a54bd21d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:59.216847 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f5f1233e-c3bc-41a7-835c-7154a54bd21d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:59.217774 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f5f1233e-c3bc-41a7-835c-7154a54bd21d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:59.222625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=80 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:59.253273 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f5f1233e-c3bc-41a7-835c-7154a54bd21d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Going to try to terminate instance {{(pid=117974) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:36:59.354161 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f5f1233e-c3bc-41a7-835c-7154a54bd21d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 204 len: 0 microversion: 2.20 time: 0.150220 May 23 15:36:59.355705 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 446/874] 10.222.0.30 () {60 vars in 1279 bytes} [Mon May 23 15:36:59 2022] DELETE /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 15:36:59.365232 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-2aa1935b-9089-49bc-b67a-fdce47e822f8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:36:59.367718 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-2aa1935b-9089-49bc-b67a-fdce47e822f8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:36:59.374082 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2aa1935b-9089-49bc-b67a-fdce47e822f8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:59.374767 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2aa1935b-9089-49bc-b67a-fdce47e822f8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:59.375774 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2aa1935b-9089-49bc-b67a-fdce47e822f8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:36:59.376459 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2aa1935b-9089-49bc-b67a-fdce47e822f8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:36:59.522939 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-2aa1935b-9089-49bc-b67a-fdce47e822f8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:59.531475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-2aa1935b-9089-49bc-b67a-fdce47e822f8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:59.533560 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-2aa1935b-9089-49bc-b67a-fdce47e822f8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:36:59.535126 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-2aa1935b-9089-49bc-b67a-fdce47e822f8 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1724 microversion: 2.20 time: 0.175115 May 23 15:36:59.535996 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 429/875] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:36:59 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:37:00.554973 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b29978b6-8b81-41ef-a038-ce7da3170c58 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:00.556330 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b29978b6-8b81-41ef-a038-ce7da3170c58 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:37:00.563265 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b29978b6-8b81-41ef-a038-ce7da3170c58 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:00.563623 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b29978b6-8b81-41ef-a038-ce7da3170c58 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:00.565089 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b29978b6-8b81-41ef-a038-ce7da3170c58 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:00.565582 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b29978b6-8b81-41ef-a038-ce7da3170c58 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:00.740095 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b29978b6-8b81-41ef-a038-ce7da3170c58 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:37:00.748594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b29978b6-8b81-41ef-a038-ce7da3170c58 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:37:00.750182 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b29978b6-8b81-41ef-a038-ce7da3170c58 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:37:00.751360 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b29978b6-8b81-41ef-a038-ce7da3170c58 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1724 microversion: 2.20 time: 0.201027 May 23 15:37:00.752083 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 447/876] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:37:00 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:37:01.770441 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-24e0e850-d03e-46b4-b31c-f4a1fdcfe21f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:01.771007 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-24e0e850-d03e-46b4-b31c-f4a1fdcfe21f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:37:01.781316 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-24e0e850-d03e-46b4-b31c-f4a1fdcfe21f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:01.781819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-24e0e850-d03e-46b4-b31c-f4a1fdcfe21f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:01.783957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-24e0e850-d03e-46b4-b31c-f4a1fdcfe21f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:01.784513 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-24e0e850-d03e-46b4-b31c-f4a1fdcfe21f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:01.888465 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-24e0e850-d03e-46b4-b31c-f4a1fdcfe21f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:37:01.902308 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-24e0e850-d03e-46b4-b31c-f4a1fdcfe21f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:37:01.904251 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-24e0e850-d03e-46b4-b31c-f4a1fdcfe21f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '139e3e42acff4c4ca8df0a7c4fc81053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c6b1563c424330ade1ef15f8efa110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:37:01.906022 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-24e0e850-d03e-46b4-b31c-f4a1fdcfe21f tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 200 len: 1656 microversion: 2.20 time: 0.139811 May 23 15:37:01.906683 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 430/877] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:37:01 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 1656 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:37:01.981064 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-44a9c3e2-67a6-41d7-a1e1-cf4e709a8fac req-8676452a-2dee-418b-8a91-f199401d8b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5c3bd6-1b7d-4c25-a705-2291f6709285", "name": "network-vif-deleted", "tag": "1163c3a8-18a2-4093-9e90-731d856e8076"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:37:01.996253 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-44a9c3e2-67a6-41d7-a1e1-cf4e709a8fac req-8676452a-2dee-418b-8a91-f199401d8b90 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:01.997170 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-44a9c3e2-67a6-41d7-a1e1-cf4e709a8fac req-8676452a-2dee-418b-8a91-f199401d8b90 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:02.052758 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-44a9c3e2-67a6-41d7-a1e1-cf4e709a8fac req-8676452a-2dee-418b-8a91-f199401d8b90 service nova] Creating event network-vif-deleted:1163c3a8-18a2-4093-9e90-731d856e8076 for instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 on hv-cinder-84112 May 23 15:37:02.067606 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-44a9c3e2-67a6-41d7-a1e1-cf4e709a8fac req-8676452a-2dee-418b-8a91-f199401d8b90 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088973 May 23 15:37:02.069845 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 448/878] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:37:02.924560 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5bdb6919-c545-435f-b0cb-267897e927df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:02.925358 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-5bdb6919-c545-435f-b0cb-267897e927df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:37:02.932690 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5bdb6919-c545-435f-b0cb-267897e927df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:02.933182 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5bdb6919-c545-435f-b0cb-267897e927df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:02.933977 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5bdb6919-c545-435f-b0cb-267897e927df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:02.934410 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5bdb6919-c545-435f-b0cb-267897e927df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:02.949656 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-5bdb6919-c545-435f-b0cb-267897e927df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] HTTP exception thrown: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5bdb6919-c545-435f-b0cb-267897e927df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Request method failure captured: May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 HTTP/1.1 May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6h7s93EUFTHH07GUtw7-KYlZcG2k5tn9NZXL-nM0vj9t2FDkMEGbp0CLOojSRZCdsEKs6sa_HKuxdYoalFRi9y70FqzlViDvtDjOKBi9ngSmF2FQhslV0e39s2WA0JMDBk-c1-9a08ZgrMFnb-XgArIjf-fBYY68rjwO_VDuxn2vS8 May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Openstack-Nova-Api-Version: 2.20 May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: 65c6b1563c424330ade1ef15f8efa110 May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:37:02.951479 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:37:02.953603 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_65c6b1563c424330ade1ef15f8efa110", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:37:02.953603 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:37:02.953603 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: 65c6b1563c424330ade1ef15f8efa110 May 23 15:37:02.953603 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:37:02.953603 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-AttachVolumeShelveTestJSON-1032588577-project May 23 15:37:02.953603 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:37:02.953603 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:37:02.953603 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: 139e3e42acff4c4ca8df0a7c4fc81053 May 23 15:37:02.953603 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1032588577-project May 23 15:37:02.953603 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:37:02.953603 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. May 23 15:37:02.953603 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': '7f5c3bd6-1b7d-4c25-a705-2291f6709285'} May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:37:02.954745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. May 23 15:37:02.956742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:02.958207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5bdb6919-c545-435f-b0cb-267897e927df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Returning 404 to user: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:37:02.958207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-5bdb6919-c545-435f-b0cb-267897e927df tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 404 len: 111 microversion: 2.20 time: 0.032994 May 23 15:37:02.958207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 431/879] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:37:02 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 15:37:02.964125 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-cea2a04d-8ccb-4f0f-b866-8b6be1b55759 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '.version_select at 0x7f0d7a50d670>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:02.996463 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-cea2a04d-8ccb-4f0f-b866-8b6be1b55759 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1001319890" status: 204 len: 0 microversion: 2.20 time: 0.036793 May 23 15:37:02.997523 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 449/880] 10.222.0.30 () {60 vars in 1261 bytes} [Mon May 23 15:37:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1001319890 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 15:37:10.042403 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-02d2414d-3d33-477b-984f-e8fc6495fda6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:10.043125 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-02d2414d-3d33-477b-984f-e8fc6495fda6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:37:10.050262 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-02d2414d-3d33-477b-984f-e8fc6495fda6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:10.050730 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-02d2414d-3d33-477b-984f-e8fc6495fda6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:10.051512 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-02d2414d-3d33-477b-984f-e8fc6495fda6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:10.051957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-02d2414d-3d33-477b-984f-e8fc6495fda6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:10.054715 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=61 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:10.069074 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-02d2414d-3d33-477b-984f-e8fc6495fda6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] HTTP exception thrown: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-02d2414d-3d33-477b-984f-e8fc6495fda6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Request method failure captured: May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: DELETE /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 HTTP/1.1 May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6h7s93EUFTHH07GUtw7-KYlZcG2k5tn9NZXL-nM0vj9t2FDkMEGbp0CLOojSRZCdsEKs6sa_HKuxdYoalFRi9y70FqzlViDvtDjOKBi9ngSmF2FQhslV0e39s2WA0JMDBk-c1-9a08ZgrMFnb-XgArIjf-fBYY68rjwO_VDuxn2vS8 May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Openstack-Nova-Api-Version: 2.20 May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: 65c6b1563c424330ade1ef15f8efa110 May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:37:10.070630 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:37:10.072251 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_65c6b1563c424330ade1ef15f8efa110", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:37:10.072251 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:37:10.072251 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: 65c6b1563c424330ade1ef15f8efa110 May 23 15:37:10.072251 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:37:10.072251 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-AttachVolumeShelveTestJSON-1032588577-project May 23 15:37:10.072251 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:37:10.072251 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:37:10.072251 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: 139e3e42acff4c4ca8df0a7c4fc81053 May 23 15:37:10.072251 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1032588577-project May 23 15:37:10.072251 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:37:10.072251 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. May 23 15:37:10.072251 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': '7f5c3bd6-1b7d-4c25-a705-2291f6709285'} May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:37:10.073189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. May 23 15:37:10.074647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:10.076032 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-02d2414d-3d33-477b-984f-e8fc6495fda6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Returning 404 to user: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:37:10.076032 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-02d2414d-3d33-477b-984f-e8fc6495fda6 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 404 len: 111 microversion: 2.20 time: 0.033796 May 23 15:37:10.076032 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 432/881] 10.222.0.30 () {60 vars in 1279 bytes} [Mon May 23 15:37:10 2022] DELETE /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 15:37:10.086818 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-dfc8e551-b330-4355-9c3a-4729f5b8602d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:10.087748 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-dfc8e551-b330-4355-9c3a-4729f5b8602d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 7f5c3bd6-1b7d-4c25-a705-2291f6709285] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:37:10.095090 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-dfc8e551-b330-4355-9c3a-4729f5b8602d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:10.095551 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-dfc8e551-b330-4355-9c3a-4729f5b8602d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:10.096998 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-dfc8e551-b330-4355-9c3a-4729f5b8602d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:10.097443 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-dfc8e551-b330-4355-9c3a-4729f5b8602d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:10.114418 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-dfc8e551-b330-4355-9c3a-4729f5b8602d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] HTTP exception thrown: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-dfc8e551-b330-4355-9c3a-4729f5b8602d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Request method failure captured: May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 HTTP/1.1 May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6h7s93EUFTHH07GUtw7-KYlZcG2k5tn9NZXL-nM0vj9t2FDkMEGbp0CLOojSRZCdsEKs6sa_HKuxdYoalFRi9y70FqzlViDvtDjOKBi9ngSmF2FQhslV0e39s2WA0JMDBk-c1-9a08ZgrMFnb-XgArIjf-fBYY68rjwO_VDuxn2vS8 May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Openstack-Nova-Api-Version: 2.20 May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 65c6b1563c424330ade1ef15f8efa110 May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:37:10.116475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:37:10.118281 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_65c6b1563c424330ade1ef15f8efa110", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:37:10.118281 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:37:10.118281 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 65c6b1563c424330ade1ef15f8efa110 May 23 15:37:10.118281 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:37:10.118281 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-AttachVolumeShelveTestJSON-1032588577-project May 23 15:37:10.118281 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:37:10.118281 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:37:10.118281 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 139e3e42acff4c4ca8df0a7c4fc81053 May 23 15:37:10.118281 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1032588577-project May 23 15:37:10.118281 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:37:10.118281 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. May 23 15:37:10.118281 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '7f5c3bd6-1b7d-4c25-a705-2291f6709285'} May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:37:10.119550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. May 23 15:37:10.120961 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:10.122532 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-dfc8e551-b330-4355-9c3a-4729f5b8602d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Returning 404 to user: Instance 7f5c3bd6-1b7d-4c25-a705-2291f6709285 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:37:10.122532 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-dfc8e551-b330-4355-9c3a-4729f5b8602d tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285" status: 404 len: 111 microversion: 2.20 time: 0.035032 May 23 15:37:10.122532 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 450/882] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:37:10 2022] GET /compute/v2.1/servers/7f5c3bd6-1b7d-4c25-a705-2291f6709285 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 15:37:11.260928 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-59aedf26-91a0-4dbc-9915-665792e8f5d4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:11.261526 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-59aedf26-91a0-4dbc-9915-665792e8f5d4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:37:11.270237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-59aedf26-91a0-4dbc-9915-665792e8f5d4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:11.270696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-59aedf26-91a0-4dbc-9915-665792e8f5d4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:11.271477 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-59aedf26-91a0-4dbc-9915-665792e8f5d4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:11.271924 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-59aedf26-91a0-4dbc-9915-665792e8f5d4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:11.287034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-59aedf26-91a0-4dbc-9915-665792e8f5d4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] HTTP exception thrown: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-59aedf26-91a0-4dbc-9915-665792e8f5d4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Request method failure captured: May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: DELETE /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 HTTP/1.1 May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6h7s93EUFTHH07GUtw7-KYlZcG2k5tn9NZXL-nM0vj9t2FDkMEGbp0CLOojSRZCdsEKs6sa_HKuxdYoalFRi9y70FqzlViDvtDjOKBi9ngSmF2FQhslV0e39s2WA0JMDBk-c1-9a08ZgrMFnb-XgArIjf-fBYY68rjwO_VDuxn2vS8 May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Openstack-Nova-Api-Version: 2.20 May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: 65c6b1563c424330ade1ef15f8efa110 May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:37:11.288625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:37:11.290057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_65c6b1563c424330ade1ef15f8efa110", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:37:11.290057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:37:11.290057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: 65c6b1563c424330ade1ef15f8efa110 May 23 15:37:11.290057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:37:11.290057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-AttachVolumeShelveTestJSON-1032588577-project May 23 15:37:11.290057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:37:11.290057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:37:11.290057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: 139e3e42acff4c4ca8df0a7c4fc81053 May 23 15:37:11.290057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1032588577-project May 23 15:37:11.290057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:37:11.290057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. May 23 15:37:11.290057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': '9b9038c8-1395-4d48-b10b-2fe7310c4c76'} May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:37:11.290795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. May 23 15:37:11.291972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:11.293215 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-59aedf26-91a0-4dbc-9915-665792e8f5d4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Returning 404 to user: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:37:11.293215 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-59aedf26-91a0-4dbc-9915-665792e8f5d4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 404 len: 111 microversion: 2.20 time: 0.033133 May 23 15:37:11.293215 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 433/883] 10.222.0.30 () {60 vars in 1279 bytes} [Mon May 23 15:37:11 2022] DELETE /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 15:37:11.300500 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-9dafc4d9-7247-4129-85cf-68636c9a00e4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:11.301161 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-9dafc4d9-7247-4129-85cf-68636c9a00e4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] [instance: 9b9038c8-1395-4d48-b10b-2fe7310c4c76] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:37:11.308344 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9dafc4d9-7247-4129-85cf-68636c9a00e4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:11.309092 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9dafc4d9-7247-4129-85cf-68636c9a00e4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:11.309877 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9dafc4d9-7247-4129-85cf-68636c9a00e4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:11.311005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9dafc4d9-7247-4129-85cf-68636c9a00e4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:11.325188 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-9dafc4d9-7247-4129-85cf-68636c9a00e4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] HTTP exception thrown: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-9dafc4d9-7247-4129-85cf-68636c9a00e4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Request method failure captured: May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 HTTP/1.1 May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6h7s93EUFTHH07GUtw7-KYlZcG2k5tn9NZXL-nM0vj9t2FDkMEGbp0CLOojSRZCdsEKs6sa_HKuxdYoalFRi9y70FqzlViDvtDjOKBi9ngSmF2FQhslV0e39s2WA0JMDBk-c1-9a08ZgrMFnb-XgArIjf-fBYY68rjwO_VDuxn2vS8 May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Openstack-Nova-Api-Version: 2.20 May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 65c6b1563c424330ade1ef15f8efa110 May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:37:11.326749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:37:11.328197 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65c6b1563c424330ade1ef15f8efa110"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_65c6b1563c424330ade1ef15f8efa110", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:37:11.328197 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:37:11.328197 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 65c6b1563c424330ade1ef15f8efa110 May 23 15:37:11.328197 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1032588577 May 23 15:37:11.328197 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-AttachVolumeShelveTestJSON-1032588577-project May 23 15:37:11.328197 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:37:11.328197 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:37:11.328197 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 139e3e42acff4c4ca8df0a7c4fc81053 May 23 15:37:11.328197 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1032588577-project May 23 15:37:11.328197 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:37:11.328197 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. May 23 15:37:11.328197 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '9b9038c8-1395-4d48-b10b-2fe7310c4c76'} May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:37:11.333141 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. May 23 15:37:11.334687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:11.336447 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-9dafc4d9-7247-4129-85cf-68636c9a00e4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] Returning 404 to user: Instance 9b9038c8-1395-4d48-b10b-2fe7310c4c76 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:37:11.336447 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-9dafc4d9-7247-4129-85cf-68636c9a00e4 tempest-AttachVolumeShelveTestJSON-1032588577 tempest-AttachVolumeShelveTestJSON-1032588577-project] 10.222.0.30 "GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76" status: 404 len: 111 microversion: 2.20 time: 0.033438 May 23 15:37:11.336447 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 451/884] 10.222.0.30 () {60 vars in 1276 bytes} [Mon May 23 15:37:11 2022] GET /compute/v2.1/servers/9b9038c8-1395-4d48-b10b-2fe7310c4c76 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 15:37:16.349223 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-692ed638-5869-4f4b-897c-2a13d34f71b8 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Action: 'create', calling method: .version_select at 0x7f0d7adb51f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1819450189"}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:37:16.664936 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-692ed638-5869-4f4b-897c-2a13d34f71b8 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.458809 May 23 15:37:16.671276 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 434/885] 10.222.0.30 () {60 vars in 1154 bytes} [Mon May 23 15:37:16 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 460 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 15:37:16.677538 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d31dbcc3-69fd-4344-a5c7-12d61b1b0b15 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Calling method '.version_select at 0x7f0d7a41f940>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:16.738937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d31dbcc3-69fd-4344-a5c7-12d61b1b0b15 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/3644f444-348c-478a-8c41-8c518aa54c1c" status: 200 len: 345 microversion: 2.1 time: 0.066328 May 23 15:37:16.739655 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 452/886] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 15:37:16 2022] GET /compute/v2.1/os-volumes/3644f444-348c-478a-8c41-8c518aa54c1c => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:37:17.753726 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-57155094-9a06-4a29-b024-41c3116e9fbe tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Calling method '.version_select at 0x7f0d7a3110d0>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:17.805898 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-57155094-9a06-4a29-b024-41c3116e9fbe tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/3644f444-348c-478a-8c41-8c518aa54c1c" status: 200 len: 346 microversion: 2.1 time: 0.056801 May 23 15:37:17.806569 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 435/887] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 15:37:17 2022] GET /compute/v2.1/os-volumes/3644f444-348c-478a-8c41-8c518aa54c1c => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:37:17.818914 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-919af240-e2a1-481b-8a57-3b22430f9ef6 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Action: 'create', calling method: .version_select at 0x7f0d7a4db430>, body: {"snapshot": {"volume_id": "3644f444-348c-478a-8c41-8c518aa54c1c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1023325252"}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:37:17.996239 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-919af240-e2a1-481b-8a57-3b22430f9ef6 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.181979 May 23 15:37:17.996898 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 453/888] 10.222.0.30 () {60 vars in 1161 bytes} [Mon May 23 15:37:17 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:37:18.010663 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1bff28bb-7620-444c-a720-f533f88a7cca tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Calling method '.version_select at 0x7f0d7a406af0>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:18.045580 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1bff28bb-7620-444c-a720-f533f88a7cca tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/270b8f5d-484d-4cb2-bf81-b3a4a6b766ef" status: 200 len: 287 microversion: 2.1 time: 0.040584 May 23 15:37:18.046170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 436/889] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 15:37:18 2022] GET /compute/v2.1/os-snapshots/270b8f5d-484d-4cb2-bf81-b3a4a6b766ef => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:37:18.059007 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ba0a854c-6d06-464a-9a73-d4b8beb2590e tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Calling method '.version_select at 0x7f0d7a50d670>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:18.090744 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ba0a854c-6d06-464a-9a73-d4b8beb2590e tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035813 May 23 15:37:18.091312 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 454/890] 10.222.0.30 () {58 vars in 1139 bytes} [Mon May 23 15:37:18 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:37:18.102236 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-77fed8c6-cc7a-4222-881e-f5654d026e50 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Calling method '.version_select at 0x7f0d7a3a0c10>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:18.132815 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-77fed8c6-cc7a-4222-881e-f5654d026e50 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/270b8f5d-484d-4cb2-bf81-b3a4a6b766ef" status: 200 len: 287 microversion: 2.1 time: 0.034485 May 23 15:37:18.133436 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 437/891] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 15:37:18 2022] GET /compute/v2.1/os-snapshots/270b8f5d-484d-4cb2-bf81-b3a4a6b766ef => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:37:19.145746 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-60973bb2-c01a-4c21-b037-9fac30b49d97 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Calling method '.version_select at 0x7f0d7a5a0790>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:19.175152 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-60973bb2-c01a-4c21-b037-9fac30b49d97 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/270b8f5d-484d-4cb2-bf81-b3a4a6b766ef" status: 200 len: 287 microversion: 2.1 time: 0.034527 May 23 15:37:19.175740 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 455/892] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 15:37:19 2022] GET /compute/v2.1/os-snapshots/270b8f5d-484d-4cb2-bf81-b3a4a6b766ef => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:37:20.187530 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-31672f13-64bc-46b9-86d1-701e7517ec41 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Calling method '.version_select at 0x7f0d7a4578b0>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:20.216704 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-31672f13-64bc-46b9-86d1-701e7517ec41 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/270b8f5d-484d-4cb2-bf81-b3a4a6b766ef" status: 200 len: 287 microversion: 2.1 time: 0.033636 May 23 15:37:20.217308 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 438/893] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 15:37:20 2022] GET /compute/v2.1/os-snapshots/270b8f5d-484d-4cb2-bf81-b3a4a6b766ef => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:37:21.228763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-0e552c85-e466-4840-b49f-c000d3c15789 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Calling method '.version_select at 0x7f0d7a5944c0>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:21.259460 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-0e552c85-e466-4840-b49f-c000d3c15789 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/270b8f5d-484d-4cb2-bf81-b3a4a6b766ef" status: 200 len: 288 microversion: 2.1 time: 0.035118 May 23 15:37:21.260013 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 456/894] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 15:37:21 2022] GET /compute/v2.1/os-snapshots/270b8f5d-484d-4cb2-bf81-b3a4a6b766ef => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:37:21.267323 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:21.272017 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-52ac877a-b95f-44f5-8777-6bbaf761659a tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Calling method '.version_select at 0x7f0d7a406b80>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:21.278254 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=3 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:21.327184 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-52ac877a-b95f-44f5-8777-6bbaf761659a tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/270b8f5d-484d-4cb2-bf81-b3a4a6b766ef" status: 202 len: 0 microversion: 2.1 time: 0.060882 May 23 15:37:21.327889 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 439/895] 10.222.0.30 () {58 vars in 1253 bytes} [Mon May 23 15:37:21 2022] DELETE /compute/v2.1/os-snapshots/270b8f5d-484d-4cb2-bf81-b3a4a6b766ef => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:37:21.333526 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:21.334269 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:21.338158 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-878fae83-a013-4d91-9e9a-60197819f204 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Calling method '.version_select at 0x7f0d7a5a0550>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:21.366959 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-878fae83-a013-4d91-9e9a-60197819f204 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/270b8f5d-484d-4cb2-bf81-b3a4a6b766ef" status: 200 len: 287 microversion: 2.1 time: 0.034136 May 23 15:37:21.367885 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 457/896] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 15:37:21 2022] GET /compute/v2.1/os-snapshots/270b8f5d-484d-4cb2-bf81-b3a4a6b766ef => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:37:22.380267 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5b8b3816-303b-4780-8bd3-ed91045dec39 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Calling method '.version_select at 0x7f0d7a3114c0>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:22.408588 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-5b8b3816-303b-4780-8bd3-ed91045dec39 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] HTTP exception thrown: Snapshot 270b8f5d-484d-4cb2-bf81-b3a4a6b766ef could not be found. May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5b8b3816-303b-4780-8bd3-ed91045dec39 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Request method failure captured: May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: GET /compute/v2.1/os-snapshots/270b8f5d-484d-4cb2-bf81-b3a4a6b766ef HTTP/1.1 May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6osig1uN53Ikg3TLDrXRJ9WbTIjsZCJbBbt9Y_yffgqzmtVLjRKhV0a9rElvEz3Kpw1Ym9amBK03MMkT7XVyIxT_WqAkmSiyTpGWwKCUls89x0TzvzJgMfnFuD1Ag7wRm96PhoOReYdaQWfIPdNzZenHm3Rkl_GPhQts8xt2tWabeg May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: 86083144dbcd42c491a8086e3800a6cd May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-102508283 May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:37:22.411802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:37:22.413442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/86083144dbcd42c491a8086e3800a6cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/86083144dbcd42c491a8086e3800a6cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/86083144dbcd42c491a8086e3800a6cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_86083144dbcd42c491a8086e3800a6cd", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:37:22.413442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-VolumesSnapshotsTestJSON-102508283 May 23 15:37:22.413442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: 86083144dbcd42c491a8086e3800a6cd May 23 15:37:22.413442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-102508283 May 23 15:37:22.413442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-VolumesSnapshotsTestJSON-102508283-project May 23 15:37:22.413442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:37:22.413442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:37:22.413442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: eeb468d8929e4a3696bc180a565a030b May 23 15:37:22.413442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-VolumesSnapshotsTestJSON-102508283-project May 23 15:37:22.413442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: May 23 15:37:22.413442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Snapshot 270b8f5d-484d-4cb2-bf81-b3a4a6b766ef could not be found. May 23 15:37:22.413442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': '270b8f5d-484d-4cb2-bf81-b3a4a6b766ef'} May 23 15:37:22.413442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 270b8f5d-484d-4cb2-bf81-b3a4a6b766ef could not be found. (HTTP 404) (Request-ID: req-92990f15-dc32-4eb4-84a6-c95ec5f790bc) May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:22.414383 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:37:22.415735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 270b8f5d-484d-4cb2-bf81-b3a4a6b766ef could not be found. May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 23 15:37:22.417201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:37:22.418625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 270b8f5d-484d-4cb2-bf81-b3a4a6b766ef could not be found. May 23 15:37:22.418625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:22.418625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:22.418625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:22.418625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:22.418625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:22.418625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:22.418625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:37:22.418625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:37:22.418625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 270b8f5d-484d-4cb2-bf81-b3a4a6b766ef could not be found. May 23 15:37:22.418625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:22.418625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5b8b3816-303b-4780-8bd3-ed91045dec39 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Returning 404 to user: Snapshot 270b8f5d-484d-4cb2-bf81-b3a4a6b766ef could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:37:22.418625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-5b8b3816-303b-4780-8bd3-ed91045dec39 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/270b8f5d-484d-4cb2-bf81-b3a4a6b766ef" status: 404 len: 111 microversion: 2.1 time: 0.038037 May 23 15:37:22.418625 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 440/897] 10.222.0.30 () {58 vars in 1250 bytes} [Mon May 23 15:37:22 2022] GET /compute/v2.1/os-snapshots/270b8f5d-484d-4cb2-bf81-b3a4a6b766ef => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:37:22.422459 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d05c43f7-9a2c-4598-9145-95b064259087 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Calling method '.version_select at 0x7f0d7a41f430>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:22.486108 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d05c43f7-9a2c-4598-9145-95b064259087 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/3644f444-348c-478a-8c41-8c518aa54c1c" status: 202 len: 0 microversion: 2.1 time: 0.067805 May 23 15:37:22.486790 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 458/898] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 15:37:22 2022] DELETE /compute/v2.1/os-volumes/3644f444-348c-478a-8c41-8c518aa54c1c => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:37:22.495460 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a015510d-7688-41e9-bd1d-930a3d612de8 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Calling method '.version_select at 0x7f0d7a449e50>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:22.548663 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a015510d-7688-41e9-bd1d-930a3d612de8 tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/3644f444-348c-478a-8c41-8c518aa54c1c" status: 200 len: 345 microversion: 2.1 time: 0.056988 May 23 15:37:22.549293 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 441/899] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 15:37:22 2022] GET /compute/v2.1/os-volumes/3644f444-348c-478a-8c41-8c518aa54c1c => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:37:23.561948 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-dada1d86-4ec3-4d6a-a859-7aa0cf33c0de tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Calling method '.version_select at 0x7f0d7a5d1ee0>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:23.597629 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-dada1d86-4ec3-4d6a-a859-7aa0cf33c0de tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] HTTP exception thrown: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-dada1d86-4ec3-4d6a-a859-7aa0cf33c0de tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Request method failure captured: May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/os-volumes/3644f444-348c-478a-8c41-8c518aa54c1c HTTP/1.1 May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6osig1uN53Ikg3TLDrXRJ9WbTIjsZCJbBbt9Y_yffgqzmtVLjRKhV0a9rElvEz3Kpw1Ym9amBK03MMkT7XVyIxT_WqAkmSiyTpGWwKCUls89x0TzvzJgMfnFuD1Ag7wRm96PhoOReYdaQWfIPdNzZenHm3Rkl_GPhQts8xt2tWabeg May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 86083144dbcd42c491a8086e3800a6cd May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-102508283 May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:37:23.599583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:37:23.601271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/86083144dbcd42c491a8086e3800a6cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/86083144dbcd42c491a8086e3800a6cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/86083144dbcd42c491a8086e3800a6cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_86083144dbcd42c491a8086e3800a6cd", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:37:23.601271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-VolumesSnapshotsTestJSON-102508283 May 23 15:37:23.601271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 86083144dbcd42c491a8086e3800a6cd May 23 15:37:23.601271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-102508283 May 23 15:37:23.601271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-VolumesSnapshotsTestJSON-102508283-project May 23 15:37:23.601271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:37:23.601271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:37:23.601271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: eeb468d8929e4a3696bc180a565a030b May 23 15:37:23.601271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-VolumesSnapshotsTestJSON-102508283-project May 23 15:37:23.601271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: May 23 15:37:23.601271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. May 23 15:37:23.601271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '3644f444-348c-478a-8c41-8c518aa54c1c'} May 23 15:37:23.601271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. (HTTP 404) (Request-ID: req-4da5209f-99fe-4421-b25e-26448f8ed9c0) May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:23.602241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:37:23.608978 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 15:37:23.610316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:37:23.613547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. May 23 15:37:23.613547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:23.613547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:23.613547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:23.613547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:23.613547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:23.613547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:23.613547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:37:23.613547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:37:23.613547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. May 23 15:37:23.613547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:23.613547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-dada1d86-4ec3-4d6a-a859-7aa0cf33c0de tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Returning 404 to user: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:37:23.613547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-dada1d86-4ec3-4d6a-a859-7aa0cf33c0de tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/3644f444-348c-478a-8c41-8c518aa54c1c" status: 404 len: 109 microversion: 2.1 time: 0.043259 May 23 15:37:23.613547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 459/900] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 15:37:23 2022] GET /compute/v2.1/os-volumes/3644f444-348c-478a-8c41-8c518aa54c1c => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:37:23.617060 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-fbac0932-7897-49d6-ac1e-7827350c8eba tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Calling method '.version_select at 0x7f0d7a311e50>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-fbac0932-7897-49d6-ac1e-7827350c8eba tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] HTTP exception thrown: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-fbac0932-7897-49d6-ac1e-7827350c8eba tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Request method failure captured: May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: DELETE /compute/v2.1/os-volumes/3644f444-348c-478a-8c41-8c518aa54c1c HTTP/1.1 May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6osig1uN53Ikg3TLDrXRJ9WbTIjsZCJbBbt9Y_yffgqzmtVLjRKhV0a9rElvEz3Kpw1Ym9amBK03MMkT7XVyIxT_WqAkmSiyTpGWwKCUls89x0TzvzJgMfnFuD1Ag7wRm96PhoOReYdaQWfIPdNzZenHm3Rkl_GPhQts8xt2tWabeg May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: 86083144dbcd42c491a8086e3800a6cd May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-102508283 May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:37:23.657207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:37:23.659355 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/86083144dbcd42c491a8086e3800a6cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/86083144dbcd42c491a8086e3800a6cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/86083144dbcd42c491a8086e3800a6cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_86083144dbcd42c491a8086e3800a6cd", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:37:23.659355 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-VolumesSnapshotsTestJSON-102508283 May 23 15:37:23.659355 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: 86083144dbcd42c491a8086e3800a6cd May 23 15:37:23.659355 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-102508283 May 23 15:37:23.659355 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-VolumesSnapshotsTestJSON-102508283-project May 23 15:37:23.659355 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:37:23.659355 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:37:23.659355 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: eeb468d8929e4a3696bc180a565a030b May 23 15:37:23.659355 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-VolumesSnapshotsTestJSON-102508283-project May 23 15:37:23.659355 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: May 23 15:37:23.659355 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. May 23 15:37:23.659355 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': '3644f444-348c-478a-8c41-8c518aa54c1c'} May 23 15:37:23.659355 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. (HTTP 404) (Request-ID: req-8c05c884-bd7d-4d94-a1ba-648c323886e9) May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:23.660149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 15:37:23.661561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 15:37:23.662890 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:37:23.664243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. May 23 15:37:23.664243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:23.664243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:23.664243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:23.664243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:23.664243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:23.664243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:23.664243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:37:23.664243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:37:23.664243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. May 23 15:37:23.664243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:37:23.664243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-fbac0932-7897-49d6-ac1e-7827350c8eba tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Returning 404 to user: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:37:23.664243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-fbac0932-7897-49d6-ac1e-7827350c8eba tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/3644f444-348c-478a-8c41-8c518aa54c1c" status: 404 len: 109 microversion: 2.1 time: 0.046423 May 23 15:37:23.667753 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3bc80dd5-bf0d-403f-9784-b5ce3241063e tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Calling method '.version_select at 0x7f0d7a5a04c0>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:23.669009 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 442/901] 10.222.0.30 () {58 vars in 1247 bytes} [Mon May 23 15:37:23 2022] DELETE /compute/v2.1/os-volumes/3644f444-348c-478a-8c41-8c518aa54c1c => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:37:23.699551 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-3bc80dd5-bf0d-403f-9784-b5ce3241063e tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] HTTP exception thrown: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3bc80dd5-bf0d-403f-9784-b5ce3241063e tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Request method failure captured: May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/os-volumes/3644f444-348c-478a-8c41-8c518aa54c1c HTTP/1.1 May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6osig1uN53Ikg3TLDrXRJ9WbTIjsZCJbBbt9Y_yffgqzmtVLjRKhV0a9rElvEz3Kpw1Ym9amBK03MMkT7XVyIxT_WqAkmSiyTpGWwKCUls89x0TzvzJgMfnFuD1Ag7wRm96PhoOReYdaQWfIPdNzZenHm3Rkl_GPhQts8xt2tWabeg May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 86083144dbcd42c491a8086e3800a6cd May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-102508283 May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:37:23.701547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:37:23.702913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/86083144dbcd42c491a8086e3800a6cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/86083144dbcd42c491a8086e3800a6cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/86083144dbcd42c491a8086e3800a6cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_86083144dbcd42c491a8086e3800a6cd", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:37:23.702913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-VolumesSnapshotsTestJSON-102508283 May 23 15:37:23.702913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 86083144dbcd42c491a8086e3800a6cd May 23 15:37:23.702913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-102508283 May 23 15:37:23.702913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-VolumesSnapshotsTestJSON-102508283-project May 23 15:37:23.702913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:37:23.702913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:37:23.702913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: eeb468d8929e4a3696bc180a565a030b May 23 15:37:23.702913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-VolumesSnapshotsTestJSON-102508283-project May 23 15:37:23.702913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: May 23 15:37:23.702913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. May 23 15:37:23.702913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '3644f444-348c-478a-8c41-8c518aa54c1c'} May 23 15:37:23.702913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. (HTTP 404) (Request-ID: req-3eb50300-576e-4e16-9343-1ce3d100f5d9) May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:23.703690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:37:23.704843 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 15:37:23.706121 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:37:23.707276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. May 23 15:37:23.707276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:23.707276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:37:23.707276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:23.707276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:37:23.707276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:37:23.707276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:37:23.707276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:37:23.707276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:37:23.707276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. May 23 15:37:23.707276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:37:23.707276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3bc80dd5-bf0d-403f-9784-b5ce3241063e tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] Returning 404 to user: Volume 3644f444-348c-478a-8c41-8c518aa54c1c could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:37:23.707276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3bc80dd5-bf0d-403f-9784-b5ce3241063e tempest-VolumesSnapshotsTestJSON-102508283 tempest-VolumesSnapshotsTestJSON-102508283-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/3644f444-348c-478a-8c41-8c518aa54c1c" status: 404 len: 109 microversion: 2.1 time: 0.039081 May 23 15:37:23.707276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 460/902] 10.222.0.30 () {58 vars in 1244 bytes} [Mon May 23 15:37:23 2022] GET /compute/v2.1/os-volumes/3644f444-348c-478a-8c41-8c518aa54c1c => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:37:50.263788 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-212a0caa-a619-40f1-bf7b-0a2f4a5a914d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1626651563", "imageRef": "807d39e3-2293-48ca-b2cd-675f7c931014", "flavorRef": "452", "networks": [{"uuid": "6495a1a0-6477-40d3-9721-b2cb09e400eb"}]}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:37:50.353707 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.network.neutron [None req-212a0caa-a619-40f1-bf7b-0a2f4a5a914d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] validate_networks() for [('6495a1a0-6477-40d3-9721-b2cb09e400eb', None, None, None, None, None)] {{(pid=117973) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:37:50.874380 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-212a0caa-a619-40f1-bf7b-0a2f4a5a914d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Flavor limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:37:50.875692 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-212a0caa-a619-40f1-bf7b-0a2f4a5a914d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Image limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:37:50.876360 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-212a0caa-a619-40f1-bf7b-0a2f4a5a914d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Flavor pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:37:50.877020 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-212a0caa-a619-40f1-bf7b-0a2f4a5a914d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Image pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:37:50.878771 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-212a0caa-a619-40f1-bf7b-0a2f4a5a914d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:37:50.894379 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-212a0caa-a619-40f1-bf7b-0a2f4a5a914d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:50.894837 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-212a0caa-a619-40f1-bf7b-0a2f4a5a914d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:50.897091 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-212a0caa-a619-40f1-bf7b-0a2f4a5a914d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:50.897555 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-212a0caa-a619-40f1-bf7b-0a2f4a5a914d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:50.931940 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-212a0caa-a619-40f1-bf7b-0a2f4a5a914d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Getting quotas for project 4b7b56a844c04f0d97fc46c39c8159ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:37:50.937338 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-212a0caa-a619-40f1-bf7b-0a2f4a5a914d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Getting quotas for user a3cfce84e75b4f5c80476c3b05c21819 and project 4b7b56a844c04f0d97fc46c39c8159ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:37:50.949708 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-212a0caa-a619-40f1-bf7b-0a2f4a5a914d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Going to run 1 instances... {{(pid=117973) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:37:50.951990 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-212a0caa-a619-40f1-bf7b-0a2f4a5a914d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='807d39e3-2293-48ca-b2cd-675f7c931014',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:37:51.006031 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-212a0caa-a619-40f1-bf7b-0a2f4a5a914d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.747354 May 23 15:37:51.006684 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 443/903] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:37:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:37:51.016889 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-59ff59a5-2cba-40c8-8416-9d094e000df0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:51.018548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-59ff59a5-2cba-40c8-8416-9d094e000df0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:37:51.122540 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-59ff59a5-2cba-40c8-8416-9d094e000df0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:37:51.132409 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-59ff59a5-2cba-40c8-8416-9d094e000df0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221" status: 200 len: 1214 microversion: 2.1 time: 0.119374 May 23 15:37:51.134665 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 461/904] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:37:51 2022] GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221 => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:37:52.152842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-9b0509d0-d8bf-4ddb-b7da-e6e8ec8d8a56 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:52.154344 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-9b0509d0-d8bf-4ddb-b7da-e6e8ec8d8a56 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:37:52.163502 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9b0509d0-d8bf-4ddb-b7da-e6e8ec8d8a56 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:52.163992 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9b0509d0-d8bf-4ddb-b7da-e6e8ec8d8a56 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:52.164792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9b0509d0-d8bf-4ddb-b7da-e6e8ec8d8a56 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:52.165349 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9b0509d0-d8bf-4ddb-b7da-e6e8ec8d8a56 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:52.245489 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9b0509d0-d8bf-4ddb-b7da-e6e8ec8d8a56 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:37:52.253986 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-9b0509d0-d8bf-4ddb-b7da-e6e8ec8d8a56 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221" status: 200 len: 1266 microversion: 2.1 time: 0.105759 May 23 15:37:52.255175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 444/905] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:37:52 2022] GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:37:53.272852 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-ee8ddf23-7d0e-428a-a911-6b97d2e5f75e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:53.273703 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-ee8ddf23-7d0e-428a-a911-6b97d2e5f75e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:37:53.281951 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ee8ddf23-7d0e-428a-a911-6b97d2e5f75e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:53.282407 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ee8ddf23-7d0e-428a-a911-6b97d2e5f75e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:53.283195 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ee8ddf23-7d0e-428a-a911-6b97d2e5f75e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:53.284815 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-ee8ddf23-7d0e-428a-a911-6b97d2e5f75e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:53.712498 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-ee8ddf23-7d0e-428a-a911-6b97d2e5f75e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:37:53.725200 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-ee8ddf23-7d0e-428a-a911-6b97d2e5f75e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221" status: 200 len: 1314 microversion: 2.1 time: 0.457029 May 23 15:37:53.726286 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 462/906] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:37:53 2022] GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:37:54.747874 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a2a4b4fb-a9e3-420c-8be3-e74e8140b3b0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:54.749114 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-a2a4b4fb-a9e3-420c-8be3-e74e8140b3b0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:37:54.757873 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a2a4b4fb-a9e3-420c-8be3-e74e8140b3b0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:54.758741 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a2a4b4fb-a9e3-420c-8be3-e74e8140b3b0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:54.759875 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a2a4b4fb-a9e3-420c-8be3-e74e8140b3b0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:54.760555 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a2a4b4fb-a9e3-420c-8be3-e74e8140b3b0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:55.091590 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-fec925b4-3e79-48e9-9e53-fe40cb4c3dc6 req-9451a503-a811-486c-a7fd-088d0a2cf439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73d09e6-350f-47aa-ac66-f4d00aa35221", "tag": "199fe9ce-22b1-4b54-8609-3dcc8871b67c"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:37:55.112253 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-fec925b4-3e79-48e9-9e53-fe40cb4c3dc6 req-9451a503-a811-486c-a7fd-088d0a2cf439 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:55.114423 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-fec925b4-3e79-48e9-9e53-fe40cb4c3dc6 req-9451a503-a811-486c-a7fd-088d0a2cf439 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:55.130012 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-fec925b4-3e79-48e9-9e53-fe40cb4c3dc6 req-9451a503-a811-486c-a7fd-088d0a2cf439 service nova] Creating event network-changed:199fe9ce-22b1-4b54-8609-3dcc8871b67c for instance c73d09e6-350f-47aa-ac66-f4d00aa35221 on hv-cinder-84112 May 23 15:37:55.136669 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-fec925b4-3e79-48e9-9e53-fe40cb4c3dc6 req-9451a503-a811-486c-a7fd-088d0a2cf439 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049250 May 23 15:37:55.137656 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 463/907] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:37:55.232649 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a2a4b4fb-a9e3-420c-8be3-e74e8140b3b0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:37:55.245527 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a2a4b4fb-a9e3-420c-8be3-e74e8140b3b0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221" status: 200 len: 1314 microversion: 2.1 time: 0.506434 May 23 15:37:55.246217 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 445/908] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:37:54 2022] GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:37:56.263381 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-485a68c0-8268-4881-b99f-592ccaad24f4 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:56.264119 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-485a68c0-8268-4881-b99f-592ccaad24f4 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:37:56.275174 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-485a68c0-8268-4881-b99f-592ccaad24f4 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:56.275623 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-485a68c0-8268-4881-b99f-592ccaad24f4 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:56.276422 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-485a68c0-8268-4881-b99f-592ccaad24f4 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:56.276883 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-485a68c0-8268-4881-b99f-592ccaad24f4 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:56.547428 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-485a68c0-8268-4881-b99f-592ccaad24f4 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:37:56.557665 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-485a68c0-8268-4881-b99f-592ccaad24f4 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221" status: 200 len: 1314 microversion: 2.1 time: 0.298526 May 23 15:37:56.558802 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 464/909] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:37:56 2022] GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:37:57.575820 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1869f4af-478b-4dd0-a27d-ee04122e4bb8 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:57.577177 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-1869f4af-478b-4dd0-a27d-ee04122e4bb8 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:37:57.596839 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1869f4af-478b-4dd0-a27d-ee04122e4bb8 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:57.598394 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1869f4af-478b-4dd0-a27d-ee04122e4bb8 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:57.602169 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1869f4af-478b-4dd0-a27d-ee04122e4bb8 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:57.602879 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1869f4af-478b-4dd0-a27d-ee04122e4bb8 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:58.079664 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-1869f4af-478b-4dd0-a27d-ee04122e4bb8 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:37:58.090868 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1869f4af-478b-4dd0-a27d-ee04122e4bb8 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221" status: 200 len: 1314 microversion: 2.1 time: 0.519035 May 23 15:37:58.091785 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 446/910] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:37:57 2022] GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:37:59.108142 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-4f47b1e3-fb7d-46ef-b01c-66b55bc4a813 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:37:59.110101 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-4f47b1e3-fb7d-46ef-b01c-66b55bc4a813 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:37:59.118652 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4f47b1e3-fb7d-46ef-b01c-66b55bc4a813 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:59.119202 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4f47b1e3-fb7d-46ef-b01c-66b55bc4a813 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:59.120142 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4f47b1e3-fb7d-46ef-b01c-66b55bc4a813 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:37:59.121108 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4f47b1e3-fb7d-46ef-b01c-66b55bc4a813 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:37:59.308255 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b9d0b1e6-bee9-473d-abfb-08db3ba15a05 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Action: 'create', calling method: .version_select at 0x7f0d7a3e0550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1729280906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAs0PFzW3mEPPcbixvrlFcwIcrEvSaZah9yn7upAyG1WgDikjal3ujfrhtDIAcrUA4hb0kRIoC6ul1zPCg8q89v2xwRsK2e6Gq1rgRkxbZOCFXnT3WONA1PXv7IO6+4jIg=="}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:37:59.341666 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-b9d0b1e6-bee9-473d-abfb-08db3ba15a05 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Getting quotas for project 449514f02fbc485484110bde5a2018c0. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:37:59.346715 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-b9d0b1e6-bee9-473d-abfb-08db3ba15a05 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Getting quotas for user 01d7c2fa381541139ea7aebaf2ae688f and project 449514f02fbc485484110bde5a2018c0. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:37:59.347558 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-4f47b1e3-fb7d-46ef-b01c-66b55bc4a813 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:37:59.357274 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-4f47b1e3-fb7d-46ef-b01c-66b55bc4a813 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221" status: 200 len: 1314 microversion: 2.1 time: 0.253045 May 23 15:37:59.367711 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 447/911] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:37:59 2022] GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:37:59.382559 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b9d0b1e6-bee9-473d-abfb-08db3ba15a05 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.330773 May 23 15:37:59.388394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 465/912] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 15:37:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:38:00.375021 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d582eaa2-e345-4009-815a-1a9e6e001141 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:00.375643 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d582eaa2-e345-4009-815a-1a9e6e001141 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:00.383099 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d582eaa2-e345-4009-815a-1a9e6e001141 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:00.383554 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d582eaa2-e345-4009-815a-1a9e6e001141 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:00.384336 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d582eaa2-e345-4009-815a-1a9e6e001141 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:00.384771 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d582eaa2-e345-4009-815a-1a9e6e001141 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:00.548313 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d582eaa2-e345-4009-815a-1a9e6e001141 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:00.561811 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d582eaa2-e345-4009-815a-1a9e6e001141 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221" status: 200 len: 1314 microversion: 2.1 time: 0.190448 May 23 15:38:00.562477 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 448/913] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:00 2022] GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:01.326642 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-665434d6-3fbf-4ee9-b442-05dc2892cdc6 req-055ca185-169a-468d-850f-8933ce906c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73d09e6-350f-47aa-ac66-f4d00aa35221", "name": "network-vif-plugged", "status": "completed", "tag": "199fe9ce-22b1-4b54-8609-3dcc8871b67c"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:01.337434 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-665434d6-3fbf-4ee9-b442-05dc2892cdc6 req-055ca185-169a-468d-850f-8933ce906c0a service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:01.338248 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-665434d6-3fbf-4ee9-b442-05dc2892cdc6 req-055ca185-169a-468d-850f-8933ce906c0a service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:01.357449 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-665434d6-3fbf-4ee9-b442-05dc2892cdc6 req-055ca185-169a-468d-850f-8933ce906c0a service nova] Creating event network-vif-plugged:199fe9ce-22b1-4b54-8609-3dcc8871b67c for instance c73d09e6-350f-47aa-ac66-f4d00aa35221 on hv-cinder-84112 May 23 15:38:01.367346 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-665434d6-3fbf-4ee9-b442-05dc2892cdc6 req-055ca185-169a-468d-850f-8933ce906c0a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045070 May 23 15:38:01.367952 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 466/914] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:38:01.582423 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-66e41270-b069-4f8d-939b-774eba8e683b tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:01.583059 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-66e41270-b069-4f8d-939b-774eba8e683b tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:01.586199 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:01.586912 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=6 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:01.595236 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-66e41270-b069-4f8d-939b-774eba8e683b tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:01.596118 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-66e41270-b069-4f8d-939b-774eba8e683b tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:01.597438 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-66e41270-b069-4f8d-939b-774eba8e683b tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:01.598384 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-66e41270-b069-4f8d-939b-774eba8e683b tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:01.873441 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-66e41270-b069-4f8d-939b-774eba8e683b tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:01.881942 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-66e41270-b069-4f8d-939b-774eba8e683b tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221" status: 200 len: 1314 microversion: 2.1 time: 0.303744 May 23 15:38:01.882523 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 449/915] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:01 2022] GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:02.910960 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-51eede0e-40da-4a6a-be96-090c41926e47 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:02.912969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-51eede0e-40da-4a6a-be96-090c41926e47 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:02.921925 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-51eede0e-40da-4a6a-be96-090c41926e47 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:02.922750 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-51eede0e-40da-4a6a-be96-090c41926e47 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:02.923789 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-51eede0e-40da-4a6a-be96-090c41926e47 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:02.924461 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-51eede0e-40da-4a6a-be96-090c41926e47 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:03.171756 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-51eede0e-40da-4a6a-be96-090c41926e47 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:03.189207 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-51eede0e-40da-4a6a-be96-090c41926e47 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221" status: 200 len: 1314 microversion: 2.1 time: 0.286916 May 23 15:38:03.189207 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 467/916] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:02 2022] GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:04.199209 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f7691f3a-dc0f-4086-9bc8-5f918c4c80d9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:04.199836 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f7691f3a-dc0f-4086-9bc8-5f918c4c80d9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:04.206472 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f7691f3a-dc0f-4086-9bc8-5f918c4c80d9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:04.206963 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f7691f3a-dc0f-4086-9bc8-5f918c4c80d9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:04.207791 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f7691f3a-dc0f-4086-9bc8-5f918c4c80d9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:04.208235 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f7691f3a-dc0f-4086-9bc8-5f918c4c80d9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:04.293749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3275a8c3-a53d-484f-899f-e6112efbe3d3 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-732318116", "imageRef": "807d39e3-2293-48ca-b2cd-675f7c931014", "flavorRef": "452"}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:04.346858 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.network.neutron [None req-3275a8c3-a53d-484f-899f-e6112efbe3d3 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] validate_networks() for None {{(pid=117974) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:38:04.355813 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f7691f3a-dc0f-4086-9bc8-5f918c4c80d9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:04.364803 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f7691f3a-dc0f-4086-9bc8-5f918c4c80d9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221" status: 200 len: 1497 microversion: 2.1 time: 0.169381 May 23 15:38:04.365404 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 450/917] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:04 2022] GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221 => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:04.650593 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-3275a8c3-a53d-484f-899f-e6112efbe3d3 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Flavor limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:38:04.650593 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-3275a8c3-a53d-484f-899f-e6112efbe3d3 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Image limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:38:04.650593 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-3275a8c3-a53d-484f-899f-e6112efbe3d3 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Flavor pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:38:04.650593 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-3275a8c3-a53d-484f-899f-e6112efbe3d3 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Image pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:38:04.650593 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-3275a8c3-a53d-484f-899f-e6112efbe3d3 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:38:04.655544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3275a8c3-a53d-484f-899f-e6112efbe3d3 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:04.656062 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3275a8c3-a53d-484f-899f-e6112efbe3d3 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:04.656975 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3275a8c3-a53d-484f-899f-e6112efbe3d3 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:04.657474 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3275a8c3-a53d-484f-899f-e6112efbe3d3 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:04.674626 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-3275a8c3-a53d-484f-899f-e6112efbe3d3 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Getting quotas for project 05e37c1d36204e1aab408ce6bfbe871a. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:38:04.680049 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-3275a8c3-a53d-484f-899f-e6112efbe3d3 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Getting quotas for user 88aedc3a8e2e4689a65fb176bfbf7762 and project 05e37c1d36204e1aab408ce6bfbe871a. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:38:04.691329 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3275a8c3-a53d-484f-899f-e6112efbe3d3 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Going to run 1 instances... {{(pid=117974) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:38:04.693614 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3275a8c3-a53d-484f-899f-e6112efbe3d3 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='807d39e3-2293-48ca-b2cd-675f7c931014',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:38:04.743069 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3275a8c3-a53d-484f-899f-e6112efbe3d3 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.453024 May 23 15:38:04.743720 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 468/918] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:38:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 15:38:04.754021 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-856410e7-d6c2-429e-8e98-da3bfc77bd3c tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:04.755189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-856410e7-d6c2-429e-8e98-da3bfc77bd3c tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:04.813029 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-856410e7-d6c2-429e-8e98-da3bfc77bd3c tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88aedc3a8e2e4689a65fb176bfbf7762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e37c1d36204e1aab408ce6bfbe871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:04.820395 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-856410e7-d6c2-429e-8e98-da3bfc77bd3c tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] 10.222.0.30 "GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518" status: 200 len: 1214 microversion: 2.1 time: 0.070642 May 23 15:38:04.824994 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 451/919] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:04 2022] GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:04.898979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2348b364-f29b-4855-834b-4ce52cd888f0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:04.899476 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-2348b364-f29b-4855-834b-4ce52cd888f0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:04.908394 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2348b364-f29b-4855-834b-4ce52cd888f0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:04.908778 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2348b364-f29b-4855-834b-4ce52cd888f0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:04.910249 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2348b364-f29b-4855-834b-4ce52cd888f0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:04.910687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2348b364-f29b-4855-834b-4ce52cd888f0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:04.937296 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-2348b364-f29b-4855-834b-4ce52cd888f0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] Going to try to terminate instance {{(pid=117974) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:38:05.020033 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-2348b364-f29b-4855-834b-4ce52cd888f0 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221" status: 204 len: 0 microversion: 2.1 time: 0.123920 May 23 15:38:05.021001 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 469/920] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:38:04 2022] DELETE /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 15:38:05.033188 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-702a8061-ecb4-42dd-a24e-81649689e03f tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:05.034017 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-702a8061-ecb4-42dd-a24e-81649689e03f tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:05.041493 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-702a8061-ecb4-42dd-a24e-81649689e03f tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:05.042191 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-702a8061-ecb4-42dd-a24e-81649689e03f tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:05.043217 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-702a8061-ecb4-42dd-a24e-81649689e03f tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:05.043714 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-702a8061-ecb4-42dd-a24e-81649689e03f tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:05.200083 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-702a8061-ecb4-42dd-a24e-81649689e03f tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:05.208239 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-702a8061-ecb4-42dd-a24e-81649689e03f tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221" status: 200 len: 1503 microversion: 2.1 time: 0.182421 May 23 15:38:05.208811 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 452/921] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:05 2022] GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221 => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:05.838782 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-eb49cbb0-56e1-4122-8166-63c06ee93ae8 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:05.839594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-eb49cbb0-56e1-4122-8166-63c06ee93ae8 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:05.846645 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eb49cbb0-56e1-4122-8166-63c06ee93ae8 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:05.847145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eb49cbb0-56e1-4122-8166-63c06ee93ae8 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:05.848046 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eb49cbb0-56e1-4122-8166-63c06ee93ae8 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:05.848490 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-eb49cbb0-56e1-4122-8166-63c06ee93ae8 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:05.909633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-eb49cbb0-56e1-4122-8166-63c06ee93ae8 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88aedc3a8e2e4689a65fb176bfbf7762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e37c1d36204e1aab408ce6bfbe871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:05.916972 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-eb49cbb0-56e1-4122-8166-63c06ee93ae8 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] 10.222.0.30 "GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518" status: 200 len: 1218 microversion: 2.1 time: 0.083459 May 23 15:38:05.917539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 470/922] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:05 2022] GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:06.226175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-e86642c3-bc25-49d8-b337-6be1550fb147 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:06.226799 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-e86642c3-bc25-49d8-b337-6be1550fb147 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:06.233467 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e86642c3-bc25-49d8-b337-6be1550fb147 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:06.233928 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e86642c3-bc25-49d8-b337-6be1550fb147 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:06.234707 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e86642c3-bc25-49d8-b337-6be1550fb147 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:06.235155 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e86642c3-bc25-49d8-b337-6be1550fb147 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:06.378787 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-e86642c3-bc25-49d8-b337-6be1550fb147 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:06.386777 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-e86642c3-bc25-49d8-b337-6be1550fb147 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221" status: 200 len: 1503 microversion: 2.1 time: 0.164988 May 23 15:38:06.387441 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 453/923] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:06 2022] GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:06.946665 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-46f4b785-2b48-4c56-b2ef-33a0f253e2d5 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:06.947500 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-46f4b785-2b48-4c56-b2ef-33a0f253e2d5 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:06.955475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-46f4b785-2b48-4c56-b2ef-33a0f253e2d5 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:06.956796 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-46f4b785-2b48-4c56-b2ef-33a0f253e2d5 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:06.958143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-46f4b785-2b48-4c56-b2ef-33a0f253e2d5 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:06.958619 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-46f4b785-2b48-4c56-b2ef-33a0f253e2d5 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:07.023091 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-46f4b785-2b48-4c56-b2ef-33a0f253e2d5 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88aedc3a8e2e4689a65fb176bfbf7762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e37c1d36204e1aab408ce6bfbe871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:07.031362 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-46f4b785-2b48-4c56-b2ef-33a0f253e2d5 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] 10.222.0.30 "GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518" status: 200 len: 1266 microversion: 2.1 time: 0.100709 May 23 15:38:07.032252 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 471/924] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:06 2022] GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:07.157253 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-7daed6ae-098d-4d7f-b86a-b7df4d7be591 req-bef9328c-c559-4fcd-97f7-53b5edc1d77e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73d09e6-350f-47aa-ac66-f4d00aa35221", "name": "network-vif-deleted", "tag": "199fe9ce-22b1-4b54-8609-3dcc8871b67c"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:07.166085 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-7daed6ae-098d-4d7f-b86a-b7df4d7be591 req-bef9328c-c559-4fcd-97f7-53b5edc1d77e service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:07.166564 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-7daed6ae-098d-4d7f-b86a-b7df4d7be591 req-bef9328c-c559-4fcd-97f7-53b5edc1d77e service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:07.178027 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-7daed6ae-098d-4d7f-b86a-b7df4d7be591 req-bef9328c-c559-4fcd-97f7-53b5edc1d77e service nova] Creating event network-vif-deleted:199fe9ce-22b1-4b54-8609-3dcc8871b67c for instance c73d09e6-350f-47aa-ac66-f4d00aa35221 on hv-cinder-84112 May 23 15:38:07.183468 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-7daed6ae-098d-4d7f-b86a-b7df4d7be591 req-bef9328c-c559-4fcd-97f7-53b5edc1d77e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030130 May 23 15:38:07.184076 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 454/925] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:38:07.404039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-fa496334-6bb7-42a2-a241-d73d04078876 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:07.405170 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-fa496334-6bb7-42a2-a241-d73d04078876 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:07.411899 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fa496334-6bb7-42a2-a241-d73d04078876 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:07.412352 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fa496334-6bb7-42a2-a241-d73d04078876 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:07.413177 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fa496334-6bb7-42a2-a241-d73d04078876 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:07.413794 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fa496334-6bb7-42a2-a241-d73d04078876 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:07.449583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fa496334-6bb7-42a2-a241-d73d04078876 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:07.450302 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fa496334-6bb7-42a2-a241-d73d04078876 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:07.450920 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-fa496334-6bb7-42a2-a241-d73d04078876 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lazy-loading 'fault' on Instance uuid c73d09e6-350f-47aa-ac66-f4d00aa35221 {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:38:07.509381 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-fa496334-6bb7-42a2-a241-d73d04078876 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:07.520036 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-fa496334-6bb7-42a2-a241-d73d04078876 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221" status: 200 len: 1304 microversion: 2.1 time: 0.119912 May 23 15:38:07.520645 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 472/926] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:07 2022] GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221 => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:08.050970 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f3af456a-1d92-453a-bdb0-ce451bd8f305 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:08.051702 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f3af456a-1d92-453a-bdb0-ce451bd8f305 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:08.058347 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f3af456a-1d92-453a-bdb0-ce451bd8f305 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:08.058797 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f3af456a-1d92-453a-bdb0-ce451bd8f305 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:08.059798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f3af456a-1d92-453a-bdb0-ce451bd8f305 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:08.060231 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f3af456a-1d92-453a-bdb0-ce451bd8f305 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:08.130996 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f3af456a-1d92-453a-bdb0-ce451bd8f305 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88aedc3a8e2e4689a65fb176bfbf7762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e37c1d36204e1aab408ce6bfbe871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:08.139142 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f3af456a-1d92-453a-bdb0-ce451bd8f305 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] 10.222.0.30 "GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518" status: 200 len: 1272 microversion: 2.1 time: 0.093446 May 23 15:38:08.139735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 455/927] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:08 2022] GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:08.538777 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-58c6aae0-5d74-41cb-b29e-8eced1dd7c2e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:08.540524 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-58c6aae0-5d74-41cb-b29e-8eced1dd7c2e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: c73d09e6-350f-47aa-ac66-f4d00aa35221] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:08.551831 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-58c6aae0-5d74-41cb-b29e-8eced1dd7c2e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:08.552439 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-58c6aae0-5d74-41cb-b29e-8eced1dd7c2e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:08.553380 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-58c6aae0-5d74-41cb-b29e-8eced1dd7c2e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:08.553942 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-58c6aae0-5d74-41cb-b29e-8eced1dd7c2e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:08.571570 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-58c6aae0-5d74-41cb-b29e-8eced1dd7c2e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] HTTP exception thrown: Instance c73d09e6-350f-47aa-ac66-f4d00aa35221 could not be found. May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-58c6aae0-5d74-41cb-b29e-8eced1dd7c2e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Request method failure captured: May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221 HTTP/1.1 May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6pMTzo_aCa-c_geM0IzosweyaSDnvdWaZNphb74dQsY_GqyzxGfR0rOAGwO9gkvjqTBCtu71I6HW1UJhN0AmOzmwp0PjrqiZGE2yA-SYl_RsuVkd83YDysKGjmjjpfSE7djQ5YTp85owZflccEvxuW122xQbtpzKuMSLNJlxzNJ_2s May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 4b7b56a844c04f0d97fc46c39c8159ce May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-VolumesActionsTest-809938195 May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:38:08.574826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:38:08.576539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b7b56a844c04f0d97fc46c39c8159ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b7b56a844c04f0d97fc46c39c8159ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b7b56a844c04f0d97fc46c39c8159ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b7b56a844c04f0d97fc46c39c8159ce", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:38:08.576539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-VolumesActionsTest-809938195 May 23 15:38:08.576539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 4b7b56a844c04f0d97fc46c39c8159ce May 23 15:38:08.576539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-VolumesActionsTest-809938195 May 23 15:38:08.576539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-VolumesActionsTest-809938195-project May 23 15:38:08.576539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:38:08.576539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:38:08.576539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: a3cfce84e75b4f5c80476c3b05c21819 May 23 15:38:08.576539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-VolumesActionsTest-809938195-project May 23 15:38:08.576539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:38:08.576539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance c73d09e6-350f-47aa-ac66-f4d00aa35221 could not be found. May 23 15:38:08.576539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': 'c73d09e6-350f-47aa-ac66-f4d00aa35221'} May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c73d09e6-350f-47aa-ac66-f4d00aa35221 could not be found. May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:38:08.577620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c73d09e6-350f-47aa-ac66-f4d00aa35221 could not be found. May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c73d09e6-350f-47aa-ac66-f4d00aa35221 could not be found. May 23 15:38:08.579143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:38:08.580475 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-58c6aae0-5d74-41cb-b29e-8eced1dd7c2e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Returning 404 to user: Instance c73d09e6-350f-47aa-ac66-f4d00aa35221 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:38:08.581265 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-58c6aae0-5d74-41cb-b29e-8eced1dd7c2e tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221" status: 404 len: 111 microversion: 2.1 time: 0.047583 May 23 15:38:08.582026 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 473/928] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:08 2022] GET /compute/v2.1/servers/c73d09e6-350f-47aa-ac66-f4d00aa35221 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:38:08.699264 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7d8ae5c9-29da-479f-a730-36a11d26066a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-240221127", "imageRef": "807d39e3-2293-48ca-b2cd-675f7c931014", "flavorRef": "452", "networks": [{"uuid": "6495a1a0-6477-40d3-9721-b2cb09e400eb"}]}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:08.772696 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.network.neutron [None req-7d8ae5c9-29da-479f-a730-36a11d26066a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] validate_networks() for [('6495a1a0-6477-40d3-9721-b2cb09e400eb', None, None, None, None, None)] {{(pid=117973) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:38:09.156374 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8e6d47a9-1090-485b-afc7-3c16ea6f263a tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:09.157046 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8e6d47a9-1090-485b-afc7-3c16ea6f263a tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:09.168786 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8e6d47a9-1090-485b-afc7-3c16ea6f263a tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:09.169376 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8e6d47a9-1090-485b-afc7-3c16ea6f263a tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:09.170219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8e6d47a9-1090-485b-afc7-3c16ea6f263a tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:09.170727 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8e6d47a9-1090-485b-afc7-3c16ea6f263a tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:09.332327 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-8e6d47a9-1090-485b-afc7-3c16ea6f263a tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88aedc3a8e2e4689a65fb176bfbf7762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e37c1d36204e1aab408ce6bfbe871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:09.341524 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8e6d47a9-1090-485b-afc7-3c16ea6f263a tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] 10.222.0.30 "GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518" status: 200 len: 1314 microversion: 2.1 time: 0.189652 May 23 15:38:09.342332 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 474/929] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:09 2022] GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:38:09.471547 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-7d8ae5c9-29da-479f-a730-36a11d26066a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Flavor limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:38:09.472451 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-7d8ae5c9-29da-479f-a730-36a11d26066a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Image limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:38:09.474200 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-7d8ae5c9-29da-479f-a730-36a11d26066a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Flavor pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:38:09.475527 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-7d8ae5c9-29da-479f-a730-36a11d26066a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Image pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:38:09.476799 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-7d8ae5c9-29da-479f-a730-36a11d26066a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:38:09.494075 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7d8ae5c9-29da-479f-a730-36a11d26066a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:09.494873 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7d8ae5c9-29da-479f-a730-36a11d26066a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:09.496165 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7d8ae5c9-29da-479f-a730-36a11d26066a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:09.496919 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7d8ae5c9-29da-479f-a730-36a11d26066a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:09.531266 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-7d8ae5c9-29da-479f-a730-36a11d26066a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Getting quotas for project 4b7b56a844c04f0d97fc46c39c8159ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:38:09.539999 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-7d8ae5c9-29da-479f-a730-36a11d26066a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Getting quotas for user a3cfce84e75b4f5c80476c3b05c21819 and project 4b7b56a844c04f0d97fc46c39c8159ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:38:09.553175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7d8ae5c9-29da-479f-a730-36a11d26066a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Going to run 1 instances... {{(pid=117973) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:38:09.555558 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7d8ae5c9-29da-479f-a730-36a11d26066a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='807d39e3-2293-48ca-b2cd-675f7c931014',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:38:09.600684 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7d8ae5c9-29da-479f-a730-36a11d26066a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.905450 May 23 15:38:09.601699 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 456/930] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:38:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:38:09.615289 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3c53b8c2-3362-4b47-9cff-da18dd61b6a9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:09.616001 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3c53b8c2-3362-4b47-9cff-da18dd61b6a9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:09.673803 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-83ce53a2-a25e-407c-8021-ee7b05e8620c req-333bd6d0-8ec3-48c4-accc-026cbe789252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d0e9bbd-949b-4a67-ac5a-3fa37a39a518", "tag": "e3b71090-fa0d-49cb-ac85-d4775ad7d838"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:09.686852 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3c53b8c2-3362-4b47-9cff-da18dd61b6a9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:09.687886 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-83ce53a2-a25e-407c-8021-ee7b05e8620c req-333bd6d0-8ec3-48c4-accc-026cbe789252 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:09.688807 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-83ce53a2-a25e-407c-8021-ee7b05e8620c req-333bd6d0-8ec3-48c4-accc-026cbe789252 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:09.702888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3c53b8c2-3362-4b47-9cff-da18dd61b6a9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0" status: 200 len: 1213 microversion: 2.1 time: 0.092378 May 23 15:38:09.703469 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 475/931] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:09 2022] GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:09.705531 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-83ce53a2-a25e-407c-8021-ee7b05e8620c req-333bd6d0-8ec3-48c4-accc-026cbe789252 service nova] Creating event network-changed:e3b71090-fa0d-49cb-ac85-d4775ad7d838 for instance 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 on hv-cinder-84112 May 23 15:38:09.715189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-83ce53a2-a25e-407c-8021-ee7b05e8620c req-333bd6d0-8ec3-48c4-accc-026cbe789252 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045078 May 23 15:38:09.716364 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 457/932] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:38:10.359893 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-19d309a6-1de8-4b0d-8a6f-4d3372a767bc tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:10.360463 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-19d309a6-1de8-4b0d-8a6f-4d3372a767bc tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:10.368150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-19d309a6-1de8-4b0d-8a6f-4d3372a767bc tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:10.368613 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-19d309a6-1de8-4b0d-8a6f-4d3372a767bc tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:10.369426 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-19d309a6-1de8-4b0d-8a6f-4d3372a767bc tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:10.369870 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-19d309a6-1de8-4b0d-8a6f-4d3372a767bc tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:10.516734 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-19d309a6-1de8-4b0d-8a6f-4d3372a767bc tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88aedc3a8e2e4689a65fb176bfbf7762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e37c1d36204e1aab408ce6bfbe871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:10.528009 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-19d309a6-1de8-4b0d-8a6f-4d3372a767bc tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] 10.222.0.30 "GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518" status: 200 len: 1314 microversion: 2.1 time: 0.172210 May 23 15:38:10.529021 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 476/933] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:10 2022] GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:10.721186 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d020b671-34b9-4467-abb6-9ddd33a93cfb tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:10.721912 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d020b671-34b9-4467-abb6-9ddd33a93cfb tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:10.729276 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d020b671-34b9-4467-abb6-9ddd33a93cfb tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:10.729734 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d020b671-34b9-4467-abb6-9ddd33a93cfb tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:10.730527 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d020b671-34b9-4467-abb6-9ddd33a93cfb tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:10.730975 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d020b671-34b9-4467-abb6-9ddd33a93cfb tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:10.797822 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d020b671-34b9-4467-abb6-9ddd33a93cfb tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:10.805456 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d020b671-34b9-4467-abb6-9ddd33a93cfb tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0" status: 200 len: 1265 microversion: 2.1 time: 0.089163 May 23 15:38:10.806127 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 458/934] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:10 2022] GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:11.547324 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4d1bf0dc-fc58-4e3d-88bb-f2b19f37fce4 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:11.548993 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4d1bf0dc-fc58-4e3d-88bb-f2b19f37fce4 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:11.557804 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4d1bf0dc-fc58-4e3d-88bb-f2b19f37fce4 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:11.558477 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4d1bf0dc-fc58-4e3d-88bb-f2b19f37fce4 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:11.559454 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4d1bf0dc-fc58-4e3d-88bb-f2b19f37fce4 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:11.560092 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4d1bf0dc-fc58-4e3d-88bb-f2b19f37fce4 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:11.774879 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4d1bf0dc-fc58-4e3d-88bb-f2b19f37fce4 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88aedc3a8e2e4689a65fb176bfbf7762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e37c1d36204e1aab408ce6bfbe871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:11.782535 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4d1bf0dc-fc58-4e3d-88bb-f2b19f37fce4 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] 10.222.0.30 "GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518" status: 200 len: 1314 microversion: 2.1 time: 0.240271 May 23 15:38:11.783099 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 477/935] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:11 2022] GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:11.823737 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f7fea0c6-1700-4a59-889a-ad40d63052f7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:11.824574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f7fea0c6-1700-4a59-889a-ad40d63052f7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:11.833584 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f7fea0c6-1700-4a59-889a-ad40d63052f7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:11.834045 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f7fea0c6-1700-4a59-889a-ad40d63052f7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:11.834832 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f7fea0c6-1700-4a59-889a-ad40d63052f7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:11.835282 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f7fea0c6-1700-4a59-889a-ad40d63052f7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:11.930832 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f7fea0c6-1700-4a59-889a-ad40d63052f7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:11.938840 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f7fea0c6-1700-4a59-889a-ad40d63052f7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0" status: 200 len: 1271 microversion: 2.1 time: 0.119556 May 23 15:38:11.939652 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 459/936] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:11 2022] GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:38:12.799614 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f1f1fa4c-f7bd-4a83-8cf1-8c61896a4a0d tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:12.800332 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f1f1fa4c-f7bd-4a83-8cf1-8c61896a4a0d tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:12.807249 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f1f1fa4c-f7bd-4a83-8cf1-8c61896a4a0d tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:12.807703 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f1f1fa4c-f7bd-4a83-8cf1-8c61896a4a0d tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:12.808479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f1f1fa4c-f7bd-4a83-8cf1-8c61896a4a0d tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:12.808946 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f1f1fa4c-f7bd-4a83-8cf1-8c61896a4a0d tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:12.955447 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-da426e26-c0be-41b1-9fbf-b932065712ac tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:12.956067 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-da426e26-c0be-41b1-9fbf-b932065712ac tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:12.963303 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-da426e26-c0be-41b1-9fbf-b932065712ac tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:12.963790 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-da426e26-c0be-41b1-9fbf-b932065712ac tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:12.964628 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-da426e26-c0be-41b1-9fbf-b932065712ac tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:12.965275 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-da426e26-c0be-41b1-9fbf-b932065712ac tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:13.102789 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-da426e26-c0be-41b1-9fbf-b932065712ac tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:13.110910 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-da426e26-c0be-41b1-9fbf-b932065712ac tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0" status: 200 len: 1313 microversion: 2.1 time: 0.159191 May 23 15:38:13.111508 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 460/937] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:12 2022] GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:38:13.243795 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-f1f1fa4c-f7bd-4a83-8cf1-8c61896a4a0d tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88aedc3a8e2e4689a65fb176bfbf7762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e37c1d36204e1aab408ce6bfbe871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:13.252955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f1f1fa4c-f7bd-4a83-8cf1-8c61896a4a0d tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] 10.222.0.30 "GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518" status: 200 len: 1314 microversion: 2.1 time: 0.457180 May 23 15:38:13.254201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 478/938] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:12 2022] GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:13.374608 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-800da8d8-f07e-4146-8002-6754399f05a5 req-d9d861ed-8e96-4607-bcde-0eff79b03f21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e98f6f3-7aca-461f-a731-9f30580c5cc0", "tag": "c4863245-8573-440d-acdf-8a7bcaafa7ff"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:13.383695 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-800da8d8-f07e-4146-8002-6754399f05a5 req-d9d861ed-8e96-4607-bcde-0eff79b03f21 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:13.384428 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-800da8d8-f07e-4146-8002-6754399f05a5 req-d9d861ed-8e96-4607-bcde-0eff79b03f21 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:13.396392 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-800da8d8-f07e-4146-8002-6754399f05a5 req-d9d861ed-8e96-4607-bcde-0eff79b03f21 service nova] Creating event network-changed:c4863245-8573-440d-acdf-8a7bcaafa7ff for instance 1e98f6f3-7aca-461f-a731-9f30580c5cc0 on hv-cinder-84112 May 23 15:38:13.401133 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-800da8d8-f07e-4146-8002-6754399f05a5 req-d9d861ed-8e96-4607-bcde-0eff79b03f21 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030186 May 23 15:38:13.402301 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 461/939] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:38:14.129150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4a409aaf-ee26-4d0e-9321-48af19b5ba24 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:14.129816 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4a409aaf-ee26-4d0e-9321-48af19b5ba24 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:14.136270 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4a409aaf-ee26-4d0e-9321-48af19b5ba24 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:14.136714 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4a409aaf-ee26-4d0e-9321-48af19b5ba24 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:14.137501 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4a409aaf-ee26-4d0e-9321-48af19b5ba24 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:14.137934 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4a409aaf-ee26-4d0e-9321-48af19b5ba24 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:14.264913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4a409aaf-ee26-4d0e-9321-48af19b5ba24 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:14.272359 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5e1b5a77-396a-4181-8b96-2c5e2cb4056b tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:14.272953 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4a409aaf-ee26-4d0e-9321-48af19b5ba24 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0" status: 200 len: 1313 microversion: 2.1 time: 0.148206 May 23 15:38:14.273149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-5e1b5a77-396a-4181-8b96-2c5e2cb4056b tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:14.282221 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 479/940] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:14 2022] GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:14.282692 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5e1b5a77-396a-4181-8b96-2c5e2cb4056b tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:14.282692 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5e1b5a77-396a-4181-8b96-2c5e2cb4056b tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:14.282692 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5e1b5a77-396a-4181-8b96-2c5e2cb4056b tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:14.282692 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5e1b5a77-396a-4181-8b96-2c5e2cb4056b tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:14.407631 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-5e1b5a77-396a-4181-8b96-2c5e2cb4056b tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88aedc3a8e2e4689a65fb176bfbf7762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e37c1d36204e1aab408ce6bfbe871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:14.415589 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-5e1b5a77-396a-4181-8b96-2c5e2cb4056b tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] 10.222.0.30 "GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518" status: 200 len: 1314 microversion: 2.1 time: 0.148696 May 23 15:38:14.416157 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 462/941] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:14 2022] GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:38:15.292239 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a7c18642-858d-483a-9ddf-aa2fe00ca48f tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:15.293291 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a7c18642-858d-483a-9ddf-aa2fe00ca48f tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:15.296330 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=2 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:15.303600 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a7c18642-858d-483a-9ddf-aa2fe00ca48f tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:15.304075 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a7c18642-858d-483a-9ddf-aa2fe00ca48f tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:15.304844 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a7c18642-858d-483a-9ddf-aa2fe00ca48f tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:15.305307 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a7c18642-858d-483a-9ddf-aa2fe00ca48f tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:15.370205 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-eb55a12f-6301-4235-854f-e28337fee85d req-95d7adc5-8483-4e25-8dfe-833a5d641305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0e9bbd-949b-4a67-ac5a-3fa37a39a518", "name": "network-vif-plugged", "status": "completed", "tag": "e3b71090-fa0d-49cb-ac85-d4775ad7d838"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:15.387006 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-eb55a12f-6301-4235-854f-e28337fee85d req-95d7adc5-8483-4e25-8dfe-833a5d641305 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:15.387797 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-eb55a12f-6301-4235-854f-e28337fee85d req-95d7adc5-8483-4e25-8dfe-833a5d641305 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:15.403176 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-eb55a12f-6301-4235-854f-e28337fee85d req-95d7adc5-8483-4e25-8dfe-833a5d641305 service nova] Creating event network-vif-plugged:e3b71090-fa0d-49cb-ac85-d4775ad7d838 for instance 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 on hv-cinder-84112 May 23 15:38:15.408822 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-eb55a12f-6301-4235-854f-e28337fee85d req-95d7adc5-8483-4e25-8dfe-833a5d641305 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042990 May 23 15:38:15.409294 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 463/942] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:38:15.433669 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1735b33d-2554-4953-a22c-1bbecbb44368 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:15.439352 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-1735b33d-2554-4953-a22c-1bbecbb44368 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:15.446447 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1735b33d-2554-4953-a22c-1bbecbb44368 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:15.446681 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1735b33d-2554-4953-a22c-1bbecbb44368 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:15.447737 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1735b33d-2554-4953-a22c-1bbecbb44368 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:15.448677 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1735b33d-2554-4953-a22c-1bbecbb44368 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:15.448796 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-a7c18642-858d-483a-9ddf-aa2fe00ca48f tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:15.457943 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a7c18642-858d-483a-9ddf-aa2fe00ca48f tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0" status: 200 len: 1313 microversion: 2.1 time: 0.171627 May 23 15:38:15.458536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 480/943] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:15 2022] GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:15.468826 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=100 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:15.881152 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-1735b33d-2554-4953-a22c-1bbecbb44368 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88aedc3a8e2e4689a65fb176bfbf7762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e37c1d36204e1aab408ce6bfbe871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:15.891751 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1735b33d-2554-4953-a22c-1bbecbb44368 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] 10.222.0.30 "GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518" status: 200 len: 1314 microversion: 2.1 time: 0.462345 May 23 15:38:15.892341 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 464/944] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:15 2022] GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:16.475966 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-37819ea1-ea38-42d9-820c-a6ae9e8ce481 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:16.476583 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-37819ea1-ea38-42d9-820c-a6ae9e8ce481 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:16.483175 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-37819ea1-ea38-42d9-820c-a6ae9e8ce481 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:16.483632 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-37819ea1-ea38-42d9-820c-a6ae9e8ce481 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:16.484399 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-37819ea1-ea38-42d9-820c-a6ae9e8ce481 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:16.484838 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-37819ea1-ea38-42d9-820c-a6ae9e8ce481 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:16.489594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:16.625753 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-37819ea1-ea38-42d9-820c-a6ae9e8ce481 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:16.633882 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-37819ea1-ea38-42d9-820c-a6ae9e8ce481 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0" status: 200 len: 1313 microversion: 2.1 time: 0.161865 May 23 15:38:16.634459 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 481/945] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:16 2022] GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:16.911548 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-83d27274-80ea-4cee-82a1-15aedab76448 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:16.912172 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-83d27274-80ea-4cee-82a1-15aedab76448 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:16.918777 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-83d27274-80ea-4cee-82a1-15aedab76448 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:16.919235 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-83d27274-80ea-4cee-82a1-15aedab76448 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:16.920016 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-83d27274-80ea-4cee-82a1-15aedab76448 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:16.920458 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-83d27274-80ea-4cee-82a1-15aedab76448 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:17.035812 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d4845755-84e1-4478-8711-10a29502e0be tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-185907059", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1729280906", "security_groups": [{"name": "tempest-secgroup-smoke-1491515110"}], "block_device_mapping_v2": [{"uuid": "5ec1fb57-856a-46b2-94df-8734fb62cf8e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ca014fd-aa0f-4216-ae7a-a155fcb74406"}]}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:17.058720 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-83d27274-80ea-4cee-82a1-15aedab76448 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88aedc3a8e2e4689a65fb176bfbf7762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e37c1d36204e1aab408ce6bfbe871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:17.066542 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-83d27274-80ea-4cee-82a1-15aedab76448 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] 10.222.0.30 "GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518" status: 200 len: 1463 microversion: 2.1 time: 0.159485 May 23 15:38:17.067194 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 465/946] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:16 2022] GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 => generated 1463 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:17.109938 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-2d74eb61-aa78-41a6-bdcf-9b3dd0906d5c tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:17.110526 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-2d74eb61-aa78-41a6-bdcf-9b3dd0906d5c tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:17.117004 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2d74eb61-aa78-41a6-bdcf-9b3dd0906d5c tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:17.117529 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2d74eb61-aa78-41a6-bdcf-9b3dd0906d5c tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:17.118308 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2d74eb61-aa78-41a6-bdcf-9b3dd0906d5c tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:17.118746 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2d74eb61-aa78-41a6-bdcf-9b3dd0906d5c tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:17.142979 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-2d74eb61-aa78-41a6-bdcf-9b3dd0906d5c tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] Going to try to terminate instance {{(pid=117973) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:38:17.150376 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.network.neutron [None req-d4845755-84e1-4478-8711-10a29502e0be tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] validate_networks() for [('5ca014fd-aa0f-4216-ae7a-a155fcb74406', None, None, None, None, None)] {{(pid=117974) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:38:17.219269 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-2d74eb61-aa78-41a6-bdcf-9b3dd0906d5c tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518" status: 204 len: 0 microversion: 2.1 time: 0.112933 May 23 15:38:17.220065 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 466/947] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:38:17 2022] DELETE /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:38:17.229060 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8305a8fe-577f-4b16-a508-b874ba993baa tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:17.229776 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8305a8fe-577f-4b16-a508-b874ba993baa tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:17.235666 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8305a8fe-577f-4b16-a508-b874ba993baa tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:17.236121 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8305a8fe-577f-4b16-a508-b874ba993baa tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:17.236962 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8305a8fe-577f-4b16-a508-b874ba993baa tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:17.237407 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8305a8fe-577f-4b16-a508-b874ba993baa tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:17.390472 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8305a8fe-577f-4b16-a508-b874ba993baa tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88aedc3a8e2e4689a65fb176bfbf7762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e37c1d36204e1aab408ce6bfbe871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:17.398602 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8305a8fe-577f-4b16-a508-b874ba993baa tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] 10.222.0.30 "GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518" status: 200 len: 1469 microversion: 2.1 time: 0.173834 May 23 15:38:17.399293 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 467/948] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:17 2022] GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 => generated 1469 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:38:17.551276 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-d4845755-84e1-4478-8711-10a29502e0be tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Flavor limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:38:17.551778 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-d4845755-84e1-4478-8711-10a29502e0be tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Image limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:38:17.552267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-d4845755-84e1-4478-8711-10a29502e0be tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Flavor pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:38:17.552690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-d4845755-84e1-4478-8711-10a29502e0be tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Image pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:38:17.553147 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-d4845755-84e1-4478-8711-10a29502e0be tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:38:17.562870 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d4845755-84e1-4478-8711-10a29502e0be tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:17.563327 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d4845755-84e1-4478-8711-10a29502e0be tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:17.564142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d4845755-84e1-4478-8711-10a29502e0be tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:17.564587 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d4845755-84e1-4478-8711-10a29502e0be tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:17.581053 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-d4845755-84e1-4478-8711-10a29502e0be tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Getting quotas for project 449514f02fbc485484110bde5a2018c0. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:38:17.585184 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-d4845755-84e1-4478-8711-10a29502e0be tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Getting quotas for user 01d7c2fa381541139ea7aebaf2ae688f and project 449514f02fbc485484110bde5a2018c0. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:38:17.642303 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d4845755-84e1-4478-8711-10a29502e0be tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Going to run 1 instances... {{(pid=117974) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:38:17.644488 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d4845755-84e1-4478-8711-10a29502e0be tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ec1fb57-856a-46b2-94df-8734fb62cf8e',volume_size=None,volume_type=None)] {{(pid=117974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:38:17.650286 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3189f496-ad17-4df7-aa25-25fc5e3c2fb6 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:17.650904 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-3189f496-ad17-4df7-aa25-25fc5e3c2fb6 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:17.657297 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3189f496-ad17-4df7-aa25-25fc5e3c2fb6 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:17.657750 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3189f496-ad17-4df7-aa25-25fc5e3c2fb6 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:17.658594 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3189f496-ad17-4df7-aa25-25fc5e3c2fb6 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:17.659034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3189f496-ad17-4df7-aa25-25fc5e3c2fb6 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:17.781159 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d4845755-84e1-4478-8711-10a29502e0be tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.749601 May 23 15:38:17.782392 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 482/949] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:38:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 15:38:17.794491 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3189f496-ad17-4df7-aa25-25fc5e3c2fb6 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:17.796017 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-24e2f302-1ea6-4c70-bacd-4d57ad5ea616 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:17.796858 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-24e2f302-1ea6-4c70-bacd-4d57ad5ea616 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:17.805539 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-3189f496-ad17-4df7-aa25-25fc5e3c2fb6 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0" status: 200 len: 1313 microversion: 2.1 time: 0.158901 May 23 15:38:17.806480 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 468/950] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:17 2022] GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:38:17.807626 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:17.858130 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-24e2f302-1ea6-4c70-bacd-4d57ad5ea616 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:17.867331 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-24e2f302-1ea6-4c70-bacd-4d57ad5ea616 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1094 microversion: 2.1 time: 0.078704 May 23 15:38:17.875101 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 483/951] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:17 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:18.417022 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-594c4a4e-4c7f-4436-a884-8e9b3e264168 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:18.417561 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-594c4a4e-4c7f-4436-a884-8e9b3e264168 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:18.424261 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-594c4a4e-4c7f-4436-a884-8e9b3e264168 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:18.424727 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-594c4a4e-4c7f-4436-a884-8e9b3e264168 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:18.426205 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-594c4a4e-4c7f-4436-a884-8e9b3e264168 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:18.426652 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-594c4a4e-4c7f-4436-a884-8e9b3e264168 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:18.563540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-594c4a4e-4c7f-4436-a884-8e9b3e264168 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88aedc3a8e2e4689a65fb176bfbf7762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e37c1d36204e1aab408ce6bfbe871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:18.572055 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-594c4a4e-4c7f-4436-a884-8e9b3e264168 tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] 10.222.0.30 "GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518" status: 200 len: 1469 microversion: 2.1 time: 0.159066 May 23 15:38:18.572634 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 469/952] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:18 2022] GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:18.822496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e61c0a02-9c0b-4fe9-ab9f-b4a82befdf7c tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:18.823265 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e61c0a02-9c0b-4fe9-ab9f-b4a82befdf7c tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:18.830020 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e61c0a02-9c0b-4fe9-ab9f-b4a82befdf7c tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:18.830537 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e61c0a02-9c0b-4fe9-ab9f-b4a82befdf7c tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:18.831429 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e61c0a02-9c0b-4fe9-ab9f-b4a82befdf7c tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:18.832466 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e61c0a02-9c0b-4fe9-ab9f-b4a82befdf7c tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:18.885136 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1da4e10c-a05c-4d53-b316-317a5422af1b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:18.885755 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-1da4e10c-a05c-4d53-b316-317a5422af1b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:18.892318 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1da4e10c-a05c-4d53-b316-317a5422af1b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:18.892774 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1da4e10c-a05c-4d53-b316-317a5422af1b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:18.893765 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1da4e10c-a05c-4d53-b316-317a5422af1b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:18.894532 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1da4e10c-a05c-4d53-b316-317a5422af1b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:18.960639 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-1da4e10c-a05c-4d53-b316-317a5422af1b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:18.968171 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1da4e10c-a05c-4d53-b316-317a5422af1b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1192 microversion: 2.1 time: 0.087135 May 23 15:38:18.968744 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 470/953] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:18 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:18.997960 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e61c0a02-9c0b-4fe9-ab9f-b4a82befdf7c tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:19.006012 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e61c0a02-9c0b-4fe9-ab9f-b4a82befdf7c tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0" status: 200 len: 1313 microversion: 2.1 time: 0.187386 May 23 15:38:19.006577 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 484/954] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:18 2022] GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:19.600284 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-44041c53-9472-4fd0-a73a-6fa11147a827 req-7c953077-86f4-4372-a804-cc4d513abc07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0e9bbd-949b-4a67-ac5a-3fa37a39a518", "name": "network-vif-deleted", "tag": "e3b71090-fa0d-49cb-ac85-d4775ad7d838"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:19.601078 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b0f2c1e3-032f-4918-98ec-f3b80a0b751a tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:19.605449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b0f2c1e3-032f-4918-98ec-f3b80a0b751a tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:19.620237 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:19.621684 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=8 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:19.629611 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-44041c53-9472-4fd0-a73a-6fa11147a827 req-7c953077-86f4-4372-a804-cc4d513abc07 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:19.632597 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-44041c53-9472-4fd0-a73a-6fa11147a827 req-7c953077-86f4-4372-a804-cc4d513abc07 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:19.640623 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b0f2c1e3-032f-4918-98ec-f3b80a0b751a tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:19.641540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b0f2c1e3-032f-4918-98ec-f3b80a0b751a tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:19.643469 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b0f2c1e3-032f-4918-98ec-f3b80a0b751a tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:19.647678 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b0f2c1e3-032f-4918-98ec-f3b80a0b751a tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:19.664195 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-44041c53-9472-4fd0-a73a-6fa11147a827 req-7c953077-86f4-4372-a804-cc4d513abc07 service nova] Creating event network-vif-deleted:e3b71090-fa0d-49cb-ac85-d4775ad7d838 for instance 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 on hv-cinder-84112 May 23 15:38:19.680296 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-44041c53-9472-4fd0-a73a-6fa11147a827 req-7c953077-86f4-4372-a804-cc4d513abc07 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086200 May 23 15:38:19.693372 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 485/955] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:38:19.702096 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-c1fe9e07-8bc0-4140-834a-e435de72ddcc req-ae2e18fe-7c01-46f4-81f1-5efb8b0991cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e98f6f3-7aca-461f-a731-9f30580c5cc0", "name": "network-vif-plugged", "status": "completed", "tag": "c4863245-8573-440d-acdf-8a7bcaafa7ff"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:19.711310 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-c1fe9e07-8bc0-4140-834a-e435de72ddcc req-ae2e18fe-7c01-46f4-81f1-5efb8b0991cc service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:19.711730 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-c1fe9e07-8bc0-4140-834a-e435de72ddcc req-ae2e18fe-7c01-46f4-81f1-5efb8b0991cc service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:19.724925 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-c1fe9e07-8bc0-4140-834a-e435de72ddcc req-ae2e18fe-7c01-46f4-81f1-5efb8b0991cc service nova] Creating event network-vif-plugged:c4863245-8573-440d-acdf-8a7bcaafa7ff for instance 1e98f6f3-7aca-461f-a731-9f30580c5cc0 on hv-cinder-84112 May 23 15:38:19.730969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-c1fe9e07-8bc0-4140-834a-e435de72ddcc req-ae2e18fe-7c01-46f4-81f1-5efb8b0991cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032406 May 23 15:38:19.732241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 486/956] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:38:19.775798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b0f2c1e3-032f-4918-98ec-f3b80a0b751a tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88aedc3a8e2e4689a65fb176bfbf7762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e37c1d36204e1aab408ce6bfbe871a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:19.788033 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b0f2c1e3-032f-4918-98ec-f3b80a0b751a tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] 10.222.0.30 "GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518" status: 200 len: 1299 microversion: 2.1 time: 0.201310 May 23 15:38:19.788807 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 471/957] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:19 2022] GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 => generated 1299 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:19.987486 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-86e8bfa7-4d0d-48c9-a106-3fbd4affb6b8 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:19.988250 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-86e8bfa7-4d0d-48c9-a106-3fbd4affb6b8 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:19.994785 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-86e8bfa7-4d0d-48c9-a106-3fbd4affb6b8 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:19.995146 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-86e8bfa7-4d0d-48c9-a106-3fbd4affb6b8 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:19.995904 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-86e8bfa7-4d0d-48c9-a106-3fbd4affb6b8 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:19.996332 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-86e8bfa7-4d0d-48c9-a106-3fbd4affb6b8 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:20.030488 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5729b17e-b69e-41ae-9d49-1d8e60ddb6f9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:20.031115 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-5729b17e-b69e-41ae-9d49-1d8e60ddb6f9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:20.042831 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5729b17e-b69e-41ae-9d49-1d8e60ddb6f9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:20.043279 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5729b17e-b69e-41ae-9d49-1d8e60ddb6f9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:20.045973 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5729b17e-b69e-41ae-9d49-1d8e60ddb6f9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:20.046827 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5729b17e-b69e-41ae-9d49-1d8e60ddb6f9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:20.271026 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-86e8bfa7-4d0d-48c9-a106-3fbd4affb6b8 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:20.289392 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-5729b17e-b69e-41ae-9d49-1d8e60ddb6f9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:20.294932 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-86e8bfa7-4d0d-48c9-a106-3fbd4affb6b8 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1278 microversion: 2.1 time: 0.312035 May 23 15:38:20.298721 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 487/958] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:19 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1278 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:20.313027 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-5729b17e-b69e-41ae-9d49-1d8e60ddb6f9 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0" status: 200 len: 1313 microversion: 2.1 time: 0.293911 May 23 15:38:20.313814 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 472/959] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:20 2022] GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:38:20.805592 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8e91e629-7301-499e-a906-2d5551920f2e tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:20.806368 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8e91e629-7301-499e-a906-2d5551920f2e tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] [instance: 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:20.813700 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8e91e629-7301-499e-a906-2d5551920f2e tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:20.814164 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8e91e629-7301-499e-a906-2d5551920f2e tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:20.814959 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8e91e629-7301-499e-a906-2d5551920f2e tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:20.815405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8e91e629-7301-499e-a906-2d5551920f2e tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:20.830720 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-8e91e629-7301-499e-a906-2d5551920f2e tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] HTTP exception thrown: Instance 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 could not be found. May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8e91e629-7301-499e-a906-2d5551920f2e tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Request method failure captured: May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 HTTP/1.1 May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6paoNeyFrwrKer1y__rqnooEMOEHXerxBa5lBcAVovYJQltf4pes5UCklt0_sXGXnGCIhvAMxlMmm17yiZA7Jb97aMCK00Y9cALXWyD9sd2Hy2AXJKSSwCtSDss69ZF254nOA6YYjjJBIxGsBqPflXAa9Vfyb8_7MmKf34uMhYIQRs May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 05e37c1d36204e1aab408ce6bfbe871a May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-VolumesNegativeTest-1449478164 May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:38:20.833166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:38:20.834716 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/05e37c1d36204e1aab408ce6bfbe871a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/05e37c1d36204e1aab408ce6bfbe871a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/05e37c1d36204e1aab408ce6bfbe871a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_05e37c1d36204e1aab408ce6bfbe871a", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:38:20.834716 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-VolumesNegativeTest-1449478164 May 23 15:38:20.834716 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 05e37c1d36204e1aab408ce6bfbe871a May 23 15:38:20.834716 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-VolumesNegativeTest-1449478164 May 23 15:38:20.834716 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-VolumesNegativeTest-1449478164-project May 23 15:38:20.834716 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:38:20.834716 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:38:20.834716 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 88aedc3a8e2e4689a65fb176bfbf7762 May 23 15:38:20.834716 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-VolumesNegativeTest-1449478164-project May 23 15:38:20.834716 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:38:20.834716 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 could not be found. May 23 15:38:20.834716 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '3d0e9bbd-949b-4a67-ac5a-3fa37a39a518'} May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 could not be found. May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:38:20.835687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 could not be found. May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 could not be found. May 23 15:38:20.837315 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:38:20.838988 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8e91e629-7301-499e-a906-2d5551920f2e tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] Returning 404 to user: Instance 3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:38:20.838988 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8e91e629-7301-499e-a906-2d5551920f2e tempest-VolumesNegativeTest-1449478164 tempest-VolumesNegativeTest-1449478164-project] 10.222.0.30 "GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518" status: 404 len: 111 microversion: 2.1 time: 0.033032 May 23 15:38:20.838988 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 488/960] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:20 2022] GET /compute/v2.1/servers/3d0e9bbd-949b-4a67-ac5a-3fa37a39a518 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:38:21.016092 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-fe6be12d-c71e-4347-aa35-d3e3c13767aa req-f97f0476-5299-4ed3-ba76-f8b7b1661c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3cec2db-2c9e-4056-91b1-e16f4981811c", "tag": "9ec6265e-1a00-4a72-a184-cf3c6c301c06"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:21.031434 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:21.039008 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-fe6be12d-c71e-4347-aa35-d3e3c13767aa req-f97f0476-5299-4ed3-ba76-f8b7b1661c9e service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:21.039544 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-fe6be12d-c71e-4347-aa35-d3e3c13767aa req-f97f0476-5299-4ed3-ba76-f8b7b1661c9e service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:21.073442 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-fe6be12d-c71e-4347-aa35-d3e3c13767aa req-f97f0476-5299-4ed3-ba76-f8b7b1661c9e service nova] Creating event network-changed:9ec6265e-1a00-4a72-a184-cf3c6c301c06 for instance d3cec2db-2c9e-4056-91b1-e16f4981811c on hv-cinder-84112 May 23 15:38:21.080624 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-fe6be12d-c71e-4347-aa35-d3e3c13767aa req-f97f0476-5299-4ed3-ba76-f8b7b1661c9e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070830 May 23 15:38:21.082116 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 473/961] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:38:21.318849 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-80c88a22-0894-43cf-ac72-a83453824733 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:21.319889 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-80c88a22-0894-43cf-ac72-a83453824733 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:21.331077 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-fad93f18-0ef8-4189-be6d-cdda5e706978 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:21.331724 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-80c88a22-0894-43cf-ac72-a83453824733 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:21.332774 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-80c88a22-0894-43cf-ac72-a83453824733 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:21.333019 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-fad93f18-0ef8-4189-be6d-cdda5e706978 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:21.336206 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-80c88a22-0894-43cf-ac72-a83453824733 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:21.336728 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-80c88a22-0894-43cf-ac72-a83453824733 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:21.339387 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fad93f18-0ef8-4189-be6d-cdda5e706978 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:21.340253 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fad93f18-0ef8-4189-be6d-cdda5e706978 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:21.341218 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fad93f18-0ef8-4189-be6d-cdda5e706978 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:21.341813 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fad93f18-0ef8-4189-be6d-cdda5e706978 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:21.487893 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-80c88a22-0894-43cf-ac72-a83453824733 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:21.498504 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-80c88a22-0894-43cf-ac72-a83453824733 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1266 microversion: 2.1 time: 0.184566 May 23 15:38:21.499526 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 489/962] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:21 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:21.504305 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-fad93f18-0ef8-4189-be6d-cdda5e706978 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:21.512035 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-fad93f18-0ef8-4189-be6d-cdda5e706978 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0" status: 200 len: 1313 microversion: 2.1 time: 0.185108 May 23 15:38:21.512776 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 474/963] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:21 2022] GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:38:22.515831 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-0fc6eeab-7fcd-4223-a0a0-07750b46334a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:22.516687 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-0fc6eeab-7fcd-4223-a0a0-07750b46334a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:22.524156 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fc6eeab-7fcd-4223-a0a0-07750b46334a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:22.529414 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d40c3414-dcf7-4119-909a-909a7e2f90b4 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:22.530043 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d40c3414-dcf7-4119-909a-909a7e2f90b4 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:22.534057 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fc6eeab-7fcd-4223-a0a0-07750b46334a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:22.534955 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fc6eeab-7fcd-4223-a0a0-07750b46334a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:22.535408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-0fc6eeab-7fcd-4223-a0a0-07750b46334a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:22.540626 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d40c3414-dcf7-4119-909a-909a7e2f90b4 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:22.541120 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d40c3414-dcf7-4119-909a-909a7e2f90b4 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:22.541906 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d40c3414-dcf7-4119-909a-909a7e2f90b4 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:22.542350 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d40c3414-dcf7-4119-909a-909a7e2f90b4 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:22.730695 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-0fc6eeab-7fcd-4223-a0a0-07750b46334a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:22.743871 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-0fc6eeab-7fcd-4223-a0a0-07750b46334a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1266 microversion: 2.1 time: 0.231905 May 23 15:38:22.744587 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 490/964] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:22 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:22.797722 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d40c3414-dcf7-4119-909a-909a7e2f90b4 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:22.806241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d40c3414-dcf7-4119-909a-909a7e2f90b4 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0" status: 200 len: 1497 microversion: 2.1 time: 0.280643 May 23 15:38:22.818284 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 475/965] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:22 2022] GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 => generated 1497 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:23.344613 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3da6ce04-2393-4aa0-b87d-a9e1520a624d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:23.344613 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3da6ce04-2393-4aa0-b87d-a9e1520a624d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:23.348998 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3da6ce04-2393-4aa0-b87d-a9e1520a624d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:23.349449 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3da6ce04-2393-4aa0-b87d-a9e1520a624d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:23.350397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3da6ce04-2393-4aa0-b87d-a9e1520a624d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:23.350934 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3da6ce04-2393-4aa0-b87d-a9e1520a624d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:23.377052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3da6ce04-2393-4aa0-b87d-a9e1520a624d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Going to try to terminate instance {{(pid=117974) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:38:23.457151 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3da6ce04-2393-4aa0-b87d-a9e1520a624d tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0" status: 204 len: 0 microversion: 2.1 time: 0.119150 May 23 15:38:23.458064 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 491/966] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:38:23 2022] DELETE /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:38:23.471614 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-dd6e6579-0cbc-49d0-bfe9-d4bd39fd3cd7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:23.472550 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-dd6e6579-0cbc-49d0-bfe9-d4bd39fd3cd7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:23.483326 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-dd6e6579-0cbc-49d0-bfe9-d4bd39fd3cd7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:23.483792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-dd6e6579-0cbc-49d0-bfe9-d4bd39fd3cd7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:23.484585 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-dd6e6579-0cbc-49d0-bfe9-d4bd39fd3cd7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:23.485095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-dd6e6579-0cbc-49d0-bfe9-d4bd39fd3cd7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:23.619815 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-dd6e6579-0cbc-49d0-bfe9-d4bd39fd3cd7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:23.627953 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-dd6e6579-0cbc-49d0-bfe9-d4bd39fd3cd7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0" status: 200 len: 1503 microversion: 2.1 time: 0.162900 May 23 15:38:23.629191 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 476/967] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:23 2022] GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:23.761347 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2ea88b53-e2ea-46b4-ba43-30a2502964df tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:23.762052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-2ea88b53-e2ea-46b4-ba43-30a2502964df tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:23.768406 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2ea88b53-e2ea-46b4-ba43-30a2502964df tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:23.768850 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2ea88b53-e2ea-46b4-ba43-30a2502964df tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:23.770288 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2ea88b53-e2ea-46b4-ba43-30a2502964df tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:23.770712 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2ea88b53-e2ea-46b4-ba43-30a2502964df tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:23.904299 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-2ea88b53-e2ea-46b4-ba43-30a2502964df tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:23.912812 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-2ea88b53-e2ea-46b4-ba43-30a2502964df tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1266 microversion: 2.1 time: 0.155878 May 23 15:38:23.913406 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 492/968] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:23 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:24.647103 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-18db6642-d825-4fd0-a061-ee63799a6b48 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:24.647753 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-18db6642-d825-4fd0-a061-ee63799a6b48 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:24.653830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-18db6642-d825-4fd0-a061-ee63799a6b48 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:24.654293 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-18db6642-d825-4fd0-a061-ee63799a6b48 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:24.655060 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-18db6642-d825-4fd0-a061-ee63799a6b48 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:24.655756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-18db6642-d825-4fd0-a061-ee63799a6b48 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:24.792347 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-18db6642-d825-4fd0-a061-ee63799a6b48 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:24.799929 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-18db6642-d825-4fd0-a061-ee63799a6b48 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0" status: 200 len: 1503 microversion: 2.1 time: 0.157321 May 23 15:38:24.800661 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 477/969] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:24 2022] GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:24.928708 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-49b1983c-13f6-4b48-bf68-9c2f0629050e tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:24.929386 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-49b1983c-13f6-4b48-bf68-9c2f0629050e tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:24.936462 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-49b1983c-13f6-4b48-bf68-9c2f0629050e tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:24.937031 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-49b1983c-13f6-4b48-bf68-9c2f0629050e tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:24.937816 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-49b1983c-13f6-4b48-bf68-9c2f0629050e tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:24.938258 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-49b1983c-13f6-4b48-bf68-9c2f0629050e tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:25.090667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-49b1983c-13f6-4b48-bf68-9c2f0629050e tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:25.099375 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-49b1983c-13f6-4b48-bf68-9c2f0629050e tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1266 microversion: 2.1 time: 0.174484 May 23 15:38:25.100060 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 493/970] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:24 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:25.518815 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-a8256133-3055-4a58-b523-4e3ed42c8d9a req-02a812ef-4ed9-4247-b79f-5d60af7e0e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e98f6f3-7aca-461f-a731-9f30580c5cc0", "name": "network-vif-deleted", "tag": "c4863245-8573-440d-acdf-8a7bcaafa7ff"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:25.527220 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-a8256133-3055-4a58-b523-4e3ed42c8d9a req-02a812ef-4ed9-4247-b79f-5d60af7e0e57 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:25.527671 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-a8256133-3055-4a58-b523-4e3ed42c8d9a req-02a812ef-4ed9-4247-b79f-5d60af7e0e57 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:25.539407 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-a8256133-3055-4a58-b523-4e3ed42c8d9a req-02a812ef-4ed9-4247-b79f-5d60af7e0e57 service nova] Creating event network-vif-deleted:c4863245-8573-440d-acdf-8a7bcaafa7ff for instance 1e98f6f3-7aca-461f-a731-9f30580c5cc0 on hv-cinder-84112 May 23 15:38:25.544147 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-a8256133-3055-4a58-b523-4e3ed42c8d9a req-02a812ef-4ed9-4247-b79f-5d60af7e0e57 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028990 May 23 15:38:25.544737 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 478/971] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:38:25.817723 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-327c498c-690b-4fe2-be20-5333b1ab6c7a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:25.818408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-327c498c-690b-4fe2-be20-5333b1ab6c7a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:25.824639 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-327c498c-690b-4fe2-be20-5333b1ab6c7a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:25.825131 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-327c498c-690b-4fe2-be20-5333b1ab6c7a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:25.825921 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-327c498c-690b-4fe2-be20-5333b1ab6c7a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:25.826364 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-327c498c-690b-4fe2-be20-5333b1ab6c7a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:25.857555 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-327c498c-690b-4fe2-be20-5333b1ab6c7a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:25.858086 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-327c498c-690b-4fe2-be20-5333b1ab6c7a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:25.858473 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-327c498c-690b-4fe2-be20-5333b1ab6c7a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lazy-loading 'fault' on Instance uuid 1e98f6f3-7aca-461f-a731-9f30580c5cc0 {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:38:25.903256 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-327c498c-690b-4fe2-be20-5333b1ab6c7a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3cfce84e75b4f5c80476c3b05c21819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7b56a844c04f0d97fc46c39c8159ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:25.911688 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-327c498c-690b-4fe2-be20-5333b1ab6c7a tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0" status: 200 len: 1303 microversion: 2.1 time: 0.098896 May 23 15:38:25.912305 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 494/972] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:25 2022] GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:26.116998 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-fbcf07ac-f21b-4457-888b-4ef7e745363c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:26.117835 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-fbcf07ac-f21b-4457-888b-4ef7e745363c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:26.124329 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fbcf07ac-f21b-4457-888b-4ef7e745363c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:26.124794 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fbcf07ac-f21b-4457-888b-4ef7e745363c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:26.125603 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fbcf07ac-f21b-4457-888b-4ef7e745363c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:26.126083 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fbcf07ac-f21b-4457-888b-4ef7e745363c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:26.268714 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-fbcf07ac-f21b-4457-888b-4ef7e745363c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:26.277261 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-fbcf07ac-f21b-4457-888b-4ef7e745363c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1266 microversion: 2.1 time: 0.164961 May 23 15:38:26.277935 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 479/973] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:26 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:26.928285 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-22379da7-64d1-45aa-8ad1-2a7e0ed8b5d7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:26.928956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-22379da7-64d1-45aa-8ad1-2a7e0ed8b5d7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] [instance: 1e98f6f3-7aca-461f-a731-9f30580c5cc0] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:26.935329 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-22379da7-64d1-45aa-8ad1-2a7e0ed8b5d7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:26.935786 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-22379da7-64d1-45aa-8ad1-2a7e0ed8b5d7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:26.936614 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-22379da7-64d1-45aa-8ad1-2a7e0ed8b5d7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:26.937085 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-22379da7-64d1-45aa-8ad1-2a7e0ed8b5d7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:26.951472 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-22379da7-64d1-45aa-8ad1-2a7e0ed8b5d7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] HTTP exception thrown: Instance 1e98f6f3-7aca-461f-a731-9f30580c5cc0 could not be found. May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-22379da7-64d1-45aa-8ad1-2a7e0ed8b5d7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Request method failure captured: May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 HTTP/1.1 May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6pMTzo_aCa-c_geM0IzosweyaSDnvdWaZNphb74dQsY_GqyzxGfR0rOAGwO9gkvjqTBCtu71I6HW1UJhN0AmOzmwp0PjrqiZGE2yA-SYl_RsuVkd83YDysKGjmjjpfSE7djQ5YTp85owZflccEvxuW122xQbtpzKuMSLNJlxzNJ_2s May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 4b7b56a844c04f0d97fc46c39c8159ce May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-VolumesActionsTest-809938195 May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:38:26.953201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:38:26.954591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b7b56a844c04f0d97fc46c39c8159ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b7b56a844c04f0d97fc46c39c8159ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b7b56a844c04f0d97fc46c39c8159ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b7b56a844c04f0d97fc46c39c8159ce", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:38:26.954591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-VolumesActionsTest-809938195 May 23 15:38:26.954591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 4b7b56a844c04f0d97fc46c39c8159ce May 23 15:38:26.954591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-VolumesActionsTest-809938195 May 23 15:38:26.954591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-VolumesActionsTest-809938195-project May 23 15:38:26.954591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:38:26.954591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:38:26.954591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: a3cfce84e75b4f5c80476c3b05c21819 May 23 15:38:26.954591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-VolumesActionsTest-809938195-project May 23 15:38:26.954591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:38:26.954591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance 1e98f6f3-7aca-461f-a731-9f30580c5cc0 could not be found. May 23 15:38:26.954591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '1e98f6f3-7aca-461f-a731-9f30580c5cc0'} May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e98f6f3-7aca-461f-a731-9f30580c5cc0 could not be found. May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:38:26.955337 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e98f6f3-7aca-461f-a731-9f30580c5cc0 could not be found. May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e98f6f3-7aca-461f-a731-9f30580c5cc0 could not be found. May 23 15:38:26.956713 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:38:26.957987 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-22379da7-64d1-45aa-8ad1-2a7e0ed8b5d7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] Returning 404 to user: Instance 1e98f6f3-7aca-461f-a731-9f30580c5cc0 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:38:26.957987 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-22379da7-64d1-45aa-8ad1-2a7e0ed8b5d7 tempest-VolumesActionsTest-809938195 tempest-VolumesActionsTest-809938195-project] 10.222.0.30 "GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0" status: 404 len: 111 microversion: 2.1 time: 0.030855 May 23 15:38:26.957987 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 495/974] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:26 2022] GET /compute/v2.1/servers/1e98f6f3-7aca-461f-a731-9f30580c5cc0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:38:27.295640 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8455eeef-7fff-40d2-9df0-039dbd2b383a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:27.296356 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8455eeef-7fff-40d2-9df0-039dbd2b383a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:27.303893 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8455eeef-7fff-40d2-9df0-039dbd2b383a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:27.304357 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8455eeef-7fff-40d2-9df0-039dbd2b383a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:27.305333 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8455eeef-7fff-40d2-9df0-039dbd2b383a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:27.305597 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8455eeef-7fff-40d2-9df0-039dbd2b383a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:27.444021 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8455eeef-7fff-40d2-9df0-039dbd2b383a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:27.447778 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:27.452997 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8455eeef-7fff-40d2-9df0-039dbd2b383a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1266 microversion: 2.1 time: 0.161262 May 23 15:38:27.453428 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 480/975] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:27 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:28.294345 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a68e8d73-ea51-41c8-a068-4a7373d1de66 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-572894808", "imageRef": "807d39e3-2293-48ca-b2cd-675f7c931014", "flavorRef": "452", "networks": [{"uuid": "eb85c015-3e09-409a-a7de-db03c09bb6f2"}]}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:28.301542 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=2 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:28.302219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=22 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:28.348548 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.network.neutron [None req-a68e8d73-ea51-41c8-a068-4a7373d1de66 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] validate_networks() for [('eb85c015-3e09-409a-a7de-db03c09bb6f2', None, None, None, None, None)] {{(pid=117974) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:38:28.470621 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-442f2593-95d9-4560-aa8b-952d385d6f2c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:28.471242 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-442f2593-95d9-4560-aa8b-952d385d6f2c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:28.479154 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-442f2593-95d9-4560-aa8b-952d385d6f2c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:28.479613 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-442f2593-95d9-4560-aa8b-952d385d6f2c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:28.480643 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-442f2593-95d9-4560-aa8b-952d385d6f2c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:28.481114 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-442f2593-95d9-4560-aa8b-952d385d6f2c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:28.616940 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-442f2593-95d9-4560-aa8b-952d385d6f2c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:28.624473 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-442f2593-95d9-4560-aa8b-952d385d6f2c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1266 microversion: 2.1 time: 0.158026 May 23 15:38:28.625170 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 481/976] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:28 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:28.700908 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-a68e8d73-ea51-41c8-a068-4a7373d1de66 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Flavor limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:38:28.701347 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-a68e8d73-ea51-41c8-a068-4a7373d1de66 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Image limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:38:28.701829 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-a68e8d73-ea51-41c8-a068-4a7373d1de66 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Flavor pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:38:28.702298 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-a68e8d73-ea51-41c8-a068-4a7373d1de66 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Image pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:38:28.702714 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-a68e8d73-ea51-41c8-a068-4a7373d1de66 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:38:28.711504 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a68e8d73-ea51-41c8-a068-4a7373d1de66 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:28.711956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a68e8d73-ea51-41c8-a068-4a7373d1de66 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:28.712766 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a68e8d73-ea51-41c8-a068-4a7373d1de66 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:28.713245 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a68e8d73-ea51-41c8-a068-4a7373d1de66 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:28.730779 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-a68e8d73-ea51-41c8-a068-4a7373d1de66 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Getting quotas for project 8fbd7396d6be4ec28f8df7c62b20d10b. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:38:28.734846 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-a68e8d73-ea51-41c8-a068-4a7373d1de66 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Getting quotas for user 434463d55cee4e25a2b0b4c70bded44e and project 8fbd7396d6be4ec28f8df7c62b20d10b. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:38:28.747159 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a68e8d73-ea51-41c8-a068-4a7373d1de66 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Going to run 1 instances... {{(pid=117974) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:38:28.749463 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a68e8d73-ea51-41c8-a068-4a7373d1de66 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='807d39e3-2293-48ca-b2cd-675f7c931014',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:38:28.794300 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a68e8d73-ea51-41c8-a068-4a7373d1de66 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503814 May 23 15:38:28.794932 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 496/977] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:38:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:38:28.805403 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f648de84-011d-4c26-9db9-2cc90f04f6d7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:28.806019 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f648de84-011d-4c26-9db9-2cc90f04f6d7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:28.857664 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f648de84-011d-4c26-9db9-2cc90f04f6d7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:28.865508 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f648de84-011d-4c26-9db9-2cc90f04f6d7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440" status: 200 len: 1218 microversion: 2.1 time: 0.064581 May 23 15:38:28.866087 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 482/978] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:28 2022] GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:29.642925 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-acb0a89e-7799-4293-99c4-ab903c3f365f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:29.643565 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-acb0a89e-7799-4293-99c4-ab903c3f365f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:29.650420 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-acb0a89e-7799-4293-99c4-ab903c3f365f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:29.650869 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-acb0a89e-7799-4293-99c4-ab903c3f365f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:29.651624 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-acb0a89e-7799-4293-99c4-ab903c3f365f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:29.652055 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-acb0a89e-7799-4293-99c4-ab903c3f365f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:29.784578 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-acb0a89e-7799-4293-99c4-ab903c3f365f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:29.793090 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-acb0a89e-7799-4293-99c4-ab903c3f365f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1266 microversion: 2.1 time: 0.154542 May 23 15:38:29.793683 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 497/979] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:29 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:29.882594 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-e8688d2c-7baf-4e56-aad7-8cc1896a9381 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:29.883241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-e8688d2c-7baf-4e56-aad7-8cc1896a9381 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:29.889873 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e8688d2c-7baf-4e56-aad7-8cc1896a9381 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:29.890331 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e8688d2c-7baf-4e56-aad7-8cc1896a9381 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:29.891127 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e8688d2c-7baf-4e56-aad7-8cc1896a9381 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:29.891570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e8688d2c-7baf-4e56-aad7-8cc1896a9381 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:29.951975 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-e8688d2c-7baf-4e56-aad7-8cc1896a9381 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:29.960100 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-e8688d2c-7baf-4e56-aad7-8cc1896a9381 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440" status: 200 len: 1222 microversion: 2.1 time: 0.081440 May 23 15:38:29.960666 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 483/980] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:29 2022] GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:30.811887 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d1724fe7-efc2-4180-8603-beb0965f425d tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:30.812521 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d1724fe7-efc2-4180-8603-beb0965f425d tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:30.819442 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d1724fe7-efc2-4180-8603-beb0965f425d tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:30.819903 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d1724fe7-efc2-4180-8603-beb0965f425d tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:30.820700 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d1724fe7-efc2-4180-8603-beb0965f425d tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:30.821166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d1724fe7-efc2-4180-8603-beb0965f425d tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:30.953305 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d1724fe7-efc2-4180-8603-beb0965f425d tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:30.962012 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d1724fe7-efc2-4180-8603-beb0965f425d tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1266 microversion: 2.1 time: 0.154869 May 23 15:38:30.962617 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 498/981] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:30 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:30.978289 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-74256e6a-7728-46c8-955d-984dec9b9a5c tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:30.979030 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-74256e6a-7728-46c8-955d-984dec9b9a5c tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:30.985737 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-74256e6a-7728-46c8-955d-984dec9b9a5c tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:30.986196 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-74256e6a-7728-46c8-955d-984dec9b9a5c tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:30.986972 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-74256e6a-7728-46c8-955d-984dec9b9a5c tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:30.987426 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-74256e6a-7728-46c8-955d-984dec9b9a5c tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:31.058555 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-74256e6a-7728-46c8-955d-984dec9b9a5c tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:31.065975 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-74256e6a-7728-46c8-955d-984dec9b9a5c tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440" status: 200 len: 1270 microversion: 2.1 time: 0.091607 May 23 15:38:31.067187 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 484/982] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:30 2022] GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:31.854005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-b23b9287-1e06-4b44-a0a6-fce3de67b332 req-6772c786-62e6-402b-a6e0-f0ddc587946a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3cec2db-2c9e-4056-91b1-e16f4981811c", "name": "network-vif-plugged", "status": "completed", "tag": "9ec6265e-1a00-4a72-a184-cf3c6c301c06"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:31.866934 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-b23b9287-1e06-4b44-a0a6-fce3de67b332 req-6772c786-62e6-402b-a6e0-f0ddc587946a service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:31.867946 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-b23b9287-1e06-4b44-a0a6-fce3de67b332 req-6772c786-62e6-402b-a6e0-f0ddc587946a service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:31.896210 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-b23b9287-1e06-4b44-a0a6-fce3de67b332 req-6772c786-62e6-402b-a6e0-f0ddc587946a service nova] Creating event network-vif-plugged:9ec6265e-1a00-4a72-a184-cf3c6c301c06 for instance d3cec2db-2c9e-4056-91b1-e16f4981811c on hv-cinder-84112 May 23 15:38:31.908851 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-b23b9287-1e06-4b44-a0a6-fce3de67b332 req-6772c786-62e6-402b-a6e0-f0ddc587946a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058849 May 23 15:38:31.910427 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 499/983] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:38:31.979266 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-335a34e0-6c6f-4a43-9c68-5fe46d9b5c93 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:31.980034 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-335a34e0-6c6f-4a43-9c68-5fe46d9b5c93 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:31.987958 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-335a34e0-6c6f-4a43-9c68-5fe46d9b5c93 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:31.988628 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-335a34e0-6c6f-4a43-9c68-5fe46d9b5c93 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:31.989617 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-335a34e0-6c6f-4a43-9c68-5fe46d9b5c93 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:31.990308 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-335a34e0-6c6f-4a43-9c68-5fe46d9b5c93 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:32.085524 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2ca973df-77cd-44f0-85c1-ddaa51e26a98 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:32.086303 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-2ca973df-77cd-44f0-85c1-ddaa51e26a98 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:32.104537 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2ca973df-77cd-44f0-85c1-ddaa51e26a98 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:32.105421 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2ca973df-77cd-44f0-85c1-ddaa51e26a98 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:32.106339 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2ca973df-77cd-44f0-85c1-ddaa51e26a98 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:32.106873 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2ca973df-77cd-44f0-85c1-ddaa51e26a98 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:32.256351 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-335a34e0-6c6f-4a43-9c68-5fe46d9b5c93 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:32.266947 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-335a34e0-6c6f-4a43-9c68-5fe46d9b5c93 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1266 microversion: 2.1 time: 0.291772 May 23 15:38:32.268061 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 485/984] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:31 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:32.329531 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-2ca973df-77cd-44f0-85c1-ddaa51e26a98 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:32.341128 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-2ca973df-77cd-44f0-85c1-ddaa51e26a98 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440" status: 200 len: 1318 microversion: 2.1 time: 0.260754 May 23 15:38:32.348399 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 500/985] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:32 2022] GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:38:32.947089 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-9d607dfc-9a46-4f98-8b4f-88a4ee5d269a req-a1acbe2c-bdd2-4a54-9f56-4c1b4c378b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70342d0c-b1ae-4a4e-ab33-02843291f440", "tag": "b33b009f-daaf-4106-8d54-393bf1c9bc90"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:32.967709 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-9d607dfc-9a46-4f98-8b4f-88a4ee5d269a req-a1acbe2c-bdd2-4a54-9f56-4c1b4c378b34 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:32.968543 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-9d607dfc-9a46-4f98-8b4f-88a4ee5d269a req-a1acbe2c-bdd2-4a54-9f56-4c1b4c378b34 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:33.001686 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-9d607dfc-9a46-4f98-8b4f-88a4ee5d269a req-a1acbe2c-bdd2-4a54-9f56-4c1b4c378b34 service nova] Creating event network-changed:b33b009f-daaf-4106-8d54-393bf1c9bc90 for instance 70342d0c-b1ae-4a4e-ab33-02843291f440 on hv-cinder-84112 May 23 15:38:33.012902 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-9d607dfc-9a46-4f98-8b4f-88a4ee5d269a req-a1acbe2c-bdd2-4a54-9f56-4c1b4c378b34 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068510 May 23 15:38:33.014297 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 486/986] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:38:33.289353 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c6325065-3d9e-4365-a6c4-9bc6a51d43cd tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:33.289924 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-c6325065-3d9e-4365-a6c4-9bc6a51d43cd tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:33.296686 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c6325065-3d9e-4365-a6c4-9bc6a51d43cd tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:33.297574 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c6325065-3d9e-4365-a6c4-9bc6a51d43cd tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:33.298753 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c6325065-3d9e-4365-a6c4-9bc6a51d43cd tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:33.299356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c6325065-3d9e-4365-a6c4-9bc6a51d43cd tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:33.322256 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:33.367758 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-86fcc79e-524c-452e-8e19-0284c215a25e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:33.369051 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-86fcc79e-524c-452e-8e19-0284c215a25e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:33.376948 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86fcc79e-524c-452e-8e19-0284c215a25e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:33.377631 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86fcc79e-524c-452e-8e19-0284c215a25e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:33.379429 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86fcc79e-524c-452e-8e19-0284c215a25e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:33.380204 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-86fcc79e-524c-452e-8e19-0284c215a25e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:33.525008 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c6325065-3d9e-4365-a6c4-9bc6a51d43cd tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:33.533612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-c6325065-3d9e-4365-a6c4-9bc6a51d43cd tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1266 microversion: 2.1 time: 0.249786 May 23 15:38:33.543752 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 501/987] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:33 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:33.579854 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-86fcc79e-524c-452e-8e19-0284c215a25e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:33.594100 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-86fcc79e-524c-452e-8e19-0284c215a25e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440" status: 200 len: 1318 microversion: 2.1 time: 0.232054 May 23 15:38:33.594947 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 487/988] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:33 2022] GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:38:34.551099 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-de17f299-d1aa-4dbd-af23-4d5c900eca65 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:34.551830 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-de17f299-d1aa-4dbd-af23-4d5c900eca65 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:34.559235 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-de17f299-d1aa-4dbd-af23-4d5c900eca65 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:34.559697 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-de17f299-d1aa-4dbd-af23-4d5c900eca65 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:34.560487 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-de17f299-d1aa-4dbd-af23-4d5c900eca65 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:34.560930 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-de17f299-d1aa-4dbd-af23-4d5c900eca65 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:34.615059 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-68a051b4-1c55-4e7e-bc95-c15c3444a7f2 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:34.615746 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-68a051b4-1c55-4e7e-bc95-c15c3444a7f2 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:34.623099 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-68a051b4-1c55-4e7e-bc95-c15c3444a7f2 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:34.623559 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-68a051b4-1c55-4e7e-bc95-c15c3444a7f2 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:34.624354 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-68a051b4-1c55-4e7e-bc95-c15c3444a7f2 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:34.624797 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-68a051b4-1c55-4e7e-bc95-c15c3444a7f2 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:34.731111 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-de17f299-d1aa-4dbd-af23-4d5c900eca65 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:34.749817 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-de17f299-d1aa-4dbd-af23-4d5c900eca65 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1453 microversion: 2.1 time: 0.202962 May 23 15:38:34.760552 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 502/989] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:34 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1453 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:34.768258 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-575edce9-a81c-43a0-8eca-2783d7673e87 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:34.769162 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-575edce9-a81c-43a0-8eca-2783d7673e87 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:34.775751 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-575edce9-a81c-43a0-8eca-2783d7673e87 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:34.776657 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-575edce9-a81c-43a0-8eca-2783d7673e87 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:34.777106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-575edce9-a81c-43a0-8eca-2783d7673e87 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:34.777636 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-575edce9-a81c-43a0-8eca-2783d7673e87 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:34.807065 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-68a051b4-1c55-4e7e-bc95-c15c3444a7f2 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:34.815070 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-68a051b4-1c55-4e7e-bc95-c15c3444a7f2 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440" status: 200 len: 1318 microversion: 2.1 time: 0.204655 May 23 15:38:34.826716 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 488/990] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:34 2022] GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:34.970986 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-575edce9-a81c-43a0-8eca-2783d7673e87 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:34.980430 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-575edce9-a81c-43a0-8eca-2783d7673e87 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1453 microversion: 2.1 time: 0.215855 May 23 15:38:34.991160 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 503/991] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:34 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1453 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:38:35.835254 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5b5468ae-c149-41de-b67c-107ffeded4cc tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:35.836676 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-5b5468ae-c149-41de-b67c-107ffeded4cc tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:35.843455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5b5468ae-c149-41de-b67c-107ffeded4cc tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:35.844118 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5b5468ae-c149-41de-b67c-107ffeded4cc tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:35.845891 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5b5468ae-c149-41de-b67c-107ffeded4cc tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:35.846735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5b5468ae-c149-41de-b67c-107ffeded4cc tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:36.012588 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-5b5468ae-c149-41de-b67c-107ffeded4cc tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:36.021609 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-5b5468ae-c149-41de-b67c-107ffeded4cc tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440" status: 200 len: 1318 microversion: 2.1 time: 0.190874 May 23 15:38:36.022730 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 489/992] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:35 2022] GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:37.040901 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2b2bb38a-5e1a-4d7d-bd08-0b94238b8900 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:37.041660 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-2b2bb38a-5e1a-4d7d-bd08-0b94238b8900 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:37.049727 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2b2bb38a-5e1a-4d7d-bd08-0b94238b8900 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:37.050741 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2b2bb38a-5e1a-4d7d-bd08-0b94238b8900 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:37.052198 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2b2bb38a-5e1a-4d7d-bd08-0b94238b8900 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:37.053005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2b2bb38a-5e1a-4d7d-bd08-0b94238b8900 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:37.292989 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-2b2bb38a-5e1a-4d7d-bd08-0b94238b8900 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:37.302754 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-2b2bb38a-5e1a-4d7d-bd08-0b94238b8900 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440" status: 200 len: 1318 microversion: 2.1 time: 0.266285 May 23 15:38:37.303975 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 504/993] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:37 2022] GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:37.467403 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-2df48030-af9a-4eaf-8c7e-4134dd1f3ca4 req-f2a67119-f796-48a3-8eb2-2c2c34a6fe93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3cec2db-2c9e-4056-91b1-e16f4981811c", "tag": "9ec6265e-1a00-4a72-a184-cf3c6c301c06"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:37.478198 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-2df48030-af9a-4eaf-8c7e-4134dd1f3ca4 req-f2a67119-f796-48a3-8eb2-2c2c34a6fe93 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:37.479608 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-2df48030-af9a-4eaf-8c7e-4134dd1f3ca4 req-f2a67119-f796-48a3-8eb2-2c2c34a6fe93 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:37.494744 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-2df48030-af9a-4eaf-8c7e-4134dd1f3ca4 req-f2a67119-f796-48a3-8eb2-2c2c34a6fe93 service nova] Creating event network-changed:9ec6265e-1a00-4a72-a184-cf3c6c301c06 for instance d3cec2db-2c9e-4056-91b1-e16f4981811c on hv-cinder-84112 May 23 15:38:37.502211 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-2df48030-af9a-4eaf-8c7e-4134dd1f3ca4 req-f2a67119-f796-48a3-8eb2-2c2c34a6fe93 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039021 May 23 15:38:37.503518 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 490/994] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:38:38.320381 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-bb9577c3-fc1a-4316-8755-59aac5fefc7f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:38.321632 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-bb9577c3-fc1a-4316-8755-59aac5fefc7f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:38.334406 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bb9577c3-fc1a-4316-8755-59aac5fefc7f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:38.335362 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bb9577c3-fc1a-4316-8755-59aac5fefc7f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:38.336678 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bb9577c3-fc1a-4316-8755-59aac5fefc7f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:38.337395 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bb9577c3-fc1a-4316-8755-59aac5fefc7f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:38.517162 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-bb9577c3-fc1a-4316-8755-59aac5fefc7f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:38.527528 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-bb9577c3-fc1a-4316-8755-59aac5fefc7f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440" status: 200 len: 1318 microversion: 2.1 time: 0.211427 May 23 15:38:38.538700 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 505/995] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:38 2022] GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:39.543758 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:39.549106 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-6641e80f-80bb-4a12-b38f-9ff3360661f0 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:39.550209 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-6641e80f-80bb-4a12-b38f-9ff3360661f0 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:39.557098 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6641e80f-80bb-4a12-b38f-9ff3360661f0 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:39.557753 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6641e80f-80bb-4a12-b38f-9ff3360661f0 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:39.558760 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6641e80f-80bb-4a12-b38f-9ff3360661f0 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:39.559505 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-6641e80f-80bb-4a12-b38f-9ff3360661f0 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:39.727707 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-6641e80f-80bb-4a12-b38f-9ff3360661f0 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:39.739201 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-6641e80f-80bb-4a12-b38f-9ff3360661f0 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440" status: 200 len: 1318 microversion: 2.1 time: 0.196174 May 23 15:38:39.749681 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 491/996] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:39 2022] GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:39.945820 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-5e8f1555-713a-49d0-9e24-585776e8817f req-9bcbe2a6-2972-4ccd-8c47-1e2a59742a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70342d0c-b1ae-4a4e-ab33-02843291f440", "name": "network-vif-plugged", "status": "completed", "tag": "b33b009f-daaf-4106-8d54-393bf1c9bc90"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:39.950099 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=2 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:39.950860 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=6 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:39.961037 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-5e8f1555-713a-49d0-9e24-585776e8817f req-9bcbe2a6-2972-4ccd-8c47-1e2a59742a2f service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:39.961773 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-5e8f1555-713a-49d0-9e24-585776e8817f req-9bcbe2a6-2972-4ccd-8c47-1e2a59742a2f service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:39.976439 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-5e8f1555-713a-49d0-9e24-585776e8817f req-9bcbe2a6-2972-4ccd-8c47-1e2a59742a2f service nova] Creating event network-vif-plugged:b33b009f-daaf-4106-8d54-393bf1c9bc90 for instance 70342d0c-b1ae-4a4e-ab33-02843291f440 on hv-cinder-84112 May 23 15:38:39.981775 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-5e8f1555-713a-49d0-9e24-585776e8817f req-9bcbe2a6-2972-4ccd-8c47-1e2a59742a2f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041242 May 23 15:38:39.982899 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 506/997] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:38:40.756658 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ddef9ac5-87d5-4ce3-ba5c-2116168d31ff tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:40.757923 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ddef9ac5-87d5-4ce3-ba5c-2116168d31ff tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:40.765172 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ddef9ac5-87d5-4ce3-ba5c-2116168d31ff tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:40.765596 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ddef9ac5-87d5-4ce3-ba5c-2116168d31ff tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:40.766409 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ddef9ac5-87d5-4ce3-ba5c-2116168d31ff tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:40.766825 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ddef9ac5-87d5-4ce3-ba5c-2116168d31ff tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:40.913243 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ddef9ac5-87d5-4ce3-ba5c-2116168d31ff tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:40.923648 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ddef9ac5-87d5-4ce3-ba5c-2116168d31ff tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440" status: 200 len: 1318 microversion: 2.1 time: 0.171288 May 23 15:38:40.924456 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 492/998] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:40 2022] GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:41.943175 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-93316949-a3a0-49b0-8c99-47f3e55c8b03 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:38:41.944792 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-93316949-a3a0-49b0-8c99-47f3e55c8b03 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:41.953407 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-93316949-a3a0-49b0-8c99-47f3e55c8b03 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:41.954294 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-93316949-a3a0-49b0-8c99-47f3e55c8b03 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:41.955807 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-93316949-a3a0-49b0-8c99-47f3e55c8b03 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:41.956616 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-93316949-a3a0-49b0-8c99-47f3e55c8b03 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:42.125136 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-93316949-a3a0-49b0-8c99-47f3e55c8b03 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:38:42.134626 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-93316949-a3a0-49b0-8c99-47f3e55c8b03 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440" status: 200 len: 1508 microversion: 2.1 time: 0.196734 May 23 15:38:42.135408 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 507/999] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:38:41 2022] GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:38:59.489936 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d8e18553-dd00-4f1d-a927-c4774fc8fa2e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a3ec7ab-efa0-452f-9566-07e4ae002b40", "device": "/dev/sdb"}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:38:59.491510 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d8e18553-dd00-4f1d-a927-c4774fc8fa2e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:38:59.493753 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=41 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:59.494416 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=58 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:59.500063 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d8e18553-dd00-4f1d-a927-c4774fc8fa2e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:59.500519 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d8e18553-dd00-4f1d-a927-c4774fc8fa2e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:59.501322 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d8e18553-dd00-4f1d-a927-c4774fc8fa2e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:38:59.501774 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d8e18553-dd00-4f1d-a927-c4774fc8fa2e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:38:59.755737 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d8e18553-dd00-4f1d-a927-c4774fc8fa2e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "POST /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270073 May 23 15:38:59.760884 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 493/1000] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 15:38:59 2022] POST /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:39:23.394622 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8e29f170-ffe3-4573-9bf2-5e3b2158c150 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:23.395128 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8e29f170-ffe3-4573-9bf2-5e3b2158c150 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:39:23.397482 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:23.398166 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=34 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:23.404789 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8e29f170-ffe3-4573-9bf2-5e3b2158c150 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:23.405264 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8e29f170-ffe3-4573-9bf2-5e3b2158c150 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:23.406038 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8e29f170-ffe3-4573-9bf2-5e3b2158c150 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:23.406474 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8e29f170-ffe3-4573-9bf2-5e3b2158c150 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:23.495522 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-8e29f170-ffe3-4573-9bf2-5e3b2158c150 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lazy-loading 'services' on Instance uuid 70342d0c-b1ae-4a4e-ab33-02843291f440 {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:39:23.564674 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8e29f170-ffe3-4573-9bf2-5e3b2158c150 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "DELETE /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440/os-volume_attachments/8a3ec7ab-efa0-452f-9566-07e4ae002b40" status: 202 len: 0 microversion: 2.1 time: 0.173939 May 23 15:39:23.565306 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 508/1001] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 15:39:23 2022] DELETE /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440/os-volume_attachments/8a3ec7ab-efa0-452f-9566-07e4ae002b40 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:39:24.683839 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-84b10dad-b1d5-423c-97bc-6b44c2f1fa16 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:24.684370 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-84b10dad-b1d5-423c-97bc-6b44c2f1fa16 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:39:24.686870 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:24.687557 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:24.694556 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-84b10dad-b1d5-423c-97bc-6b44c2f1fa16 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:24.695007 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-84b10dad-b1d5-423c-97bc-6b44c2f1fa16 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:24.695778 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-84b10dad-b1d5-423c-97bc-6b44c2f1fa16 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:24.696216 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-84b10dad-b1d5-423c-97bc-6b44c2f1fa16 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:24.722019 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-84b10dad-b1d5-423c-97bc-6b44c2f1fa16 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Going to try to terminate instance {{(pid=117973) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:39:24.794508 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-84b10dad-b1d5-423c-97bc-6b44c2f1fa16 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "DELETE /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440" status: 204 len: 0 microversion: 2.1 time: 0.114612 May 23 15:39:24.795104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 494/1002] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:39:24 2022] DELETE /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:39:24.805137 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-83c63c54-a1f8-4452-9d2f-7725c186d401 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:24.805848 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-83c63c54-a1f8-4452-9d2f-7725c186d401 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:39:24.812154 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-83c63c54-a1f8-4452-9d2f-7725c186d401 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:24.812609 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-83c63c54-a1f8-4452-9d2f-7725c186d401 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:24.813415 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-83c63c54-a1f8-4452-9d2f-7725c186d401 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:24.813860 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-83c63c54-a1f8-4452-9d2f-7725c186d401 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:24.941794 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-83c63c54-a1f8-4452-9d2f-7725c186d401 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:39:24.950139 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-83c63c54-a1f8-4452-9d2f-7725c186d401 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440" status: 200 len: 1514 microversion: 2.1 time: 0.150561 May 23 15:39:24.950698 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 509/1003] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:39:24 2022] GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:39:25.967850 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8105a4e0-b5d9-4ffe-b211-a6c7f9ec4026 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:25.968590 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8105a4e0-b5d9-4ffe-b211-a6c7f9ec4026 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:39:25.975189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8105a4e0-b5d9-4ffe-b211-a6c7f9ec4026 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:25.975647 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8105a4e0-b5d9-4ffe-b211-a6c7f9ec4026 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:25.976413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8105a4e0-b5d9-4ffe-b211-a6c7f9ec4026 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:25.976856 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8105a4e0-b5d9-4ffe-b211-a6c7f9ec4026 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:26.110289 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-8105a4e0-b5d9-4ffe-b211-a6c7f9ec4026 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:39:26.118319 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8105a4e0-b5d9-4ffe-b211-a6c7f9ec4026 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440" status: 200 len: 1514 microversion: 2.1 time: 0.154740 May 23 15:39:26.118888 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 495/1004] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:39:25 2022] GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:39:27.132206 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-798292b5-1edf-4c95-865f-59bd4281a45d req-514697b9-3c29-4596-b78c-a4bd463b9a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70342d0c-b1ae-4a4e-ab33-02843291f440", "name": "network-vif-deleted", "tag": "b33b009f-daaf-4106-8d54-393bf1c9bc90"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:39:27.136227 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-694e0932-0a93-4b86-a24a-03e414cf095c tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:27.136877 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-694e0932-0a93-4b86-a24a-03e414cf095c tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:39:27.143363 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-798292b5-1edf-4c95-865f-59bd4281a45d req-514697b9-3c29-4596-b78c-a4bd463b9a6a service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:27.143540 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-694e0932-0a93-4b86-a24a-03e414cf095c tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:27.143815 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-798292b5-1edf-4c95-865f-59bd4281a45d req-514697b9-3c29-4596-b78c-a4bd463b9a6a service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:27.143940 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-694e0932-0a93-4b86-a24a-03e414cf095c tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:27.144592 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-694e0932-0a93-4b86-a24a-03e414cf095c tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:27.145126 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-694e0932-0a93-4b86-a24a-03e414cf095c tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:27.156556 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-798292b5-1edf-4c95-865f-59bd4281a45d req-514697b9-3c29-4596-b78c-a4bd463b9a6a service nova] Creating event network-vif-deleted:b33b009f-daaf-4106-8d54-393bf1c9bc90 for instance 70342d0c-b1ae-4a4e-ab33-02843291f440 on hv-cinder-84112 May 23 15:39:27.162674 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-798292b5-1edf-4c95-865f-59bd4281a45d req-514697b9-3c29-4596-b78c-a4bd463b9a6a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034797 May 23 15:39:27.163482 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 510/1005] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:39:27.210580 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-694e0932-0a93-4b86-a24a-03e414cf095c tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:39:27.218951 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-694e0932-0a93-4b86-a24a-03e414cf095c tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440" status: 200 len: 1472 microversion: 2.1 time: 0.087101 May 23 15:39:27.219602 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 496/1006] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:39:27 2022] GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 => generated 1472 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:39:28.236699 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-138a6cf9-743c-4681-9c07-5af7bedbf4b5 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:28.237437 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-138a6cf9-743c-4681-9c07-5af7bedbf4b5 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 70342d0c-b1ae-4a4e-ab33-02843291f440] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:39:28.244555 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-138a6cf9-743c-4681-9c07-5af7bedbf4b5 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:28.245041 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-138a6cf9-743c-4681-9c07-5af7bedbf4b5 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:28.245815 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-138a6cf9-743c-4681-9c07-5af7bedbf4b5 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:28.246284 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-138a6cf9-743c-4681-9c07-5af7bedbf4b5 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:28.260547 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-138a6cf9-743c-4681-9c07-5af7bedbf4b5 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] HTTP exception thrown: Instance 70342d0c-b1ae-4a4e-ab33-02843291f440 could not be found. May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-138a6cf9-743c-4681-9c07-5af7bedbf4b5 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Request method failure captured: May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 HTTP/1.1 May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6pyY4-VHk2H5asgdBSIEBc87sCUqiAcG-xwaEgr9BAgG1zf0yEHEAXGNWCL-POsV-_FqXDQx76D7z8T2n5axgYfq3wZ9zcG4P5ki9jRSssjyC-cxbgkCjpyeHrtE7Huq_P9h0ZELbOpquBDphcjFqvsanNgIhATTrh9bydzLyVd21Q May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 8fbd7396d6be4ec28f8df7c62b20d10b May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-VolumesSnapshotTestJSON-278806103 May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:39:28.262219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:39:28.263874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8fbd7396d6be4ec28f8df7c62b20d10b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8fbd7396d6be4ec28f8df7c62b20d10b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8fbd7396d6be4ec28f8df7c62b20d10b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8fbd7396d6be4ec28f8df7c62b20d10b", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:39:28.263874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-VolumesSnapshotTestJSON-278806103 May 23 15:39:28.263874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 8fbd7396d6be4ec28f8df7c62b20d10b May 23 15:39:28.263874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-278806103 May 23 15:39:28.263874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-VolumesSnapshotTestJSON-278806103-project May 23 15:39:28.263874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:39:28.263874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:39:28.263874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 434463d55cee4e25a2b0b4c70bded44e May 23 15:39:28.263874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-VolumesSnapshotTestJSON-278806103-project May 23 15:39:28.263874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:39:28.263874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance 70342d0c-b1ae-4a4e-ab33-02843291f440 could not be found. May 23 15:39:28.263874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '70342d0c-b1ae-4a4e-ab33-02843291f440'} May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70342d0c-b1ae-4a4e-ab33-02843291f440 could not be found. May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:39:28.264888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70342d0c-b1ae-4a4e-ab33-02843291f440 could not be found. May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70342d0c-b1ae-4a4e-ab33-02843291f440 could not be found. May 23 15:39:28.266451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:39:28.267837 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-138a6cf9-743c-4681-9c07-5af7bedbf4b5 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Returning 404 to user: Instance 70342d0c-b1ae-4a4e-ab33-02843291f440 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:39:28.267837 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-138a6cf9-743c-4681-9c07-5af7bedbf4b5 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440" status: 404 len: 111 microversion: 2.1 time: 0.031496 May 23 15:39:28.267837 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 511/1007] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:39:28 2022] GET /compute/v2.1/servers/70342d0c-b1ae-4a4e-ab33-02843291f440 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:39:36.049521 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1838a64a-b537-4411-a936-6e27a8e1b45e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2094473124", "imageRef": "807d39e3-2293-48ca-b2cd-675f7c931014", "flavorRef": "452", "networks": [{"uuid": "eb85c015-3e09-409a-a7de-db03c09bb6f2"}]}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:39:36.099570 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.network.neutron [None req-1838a64a-b537-4411-a936-6e27a8e1b45e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] validate_networks() for [('eb85c015-3e09-409a-a7de-db03c09bb6f2', None, None, None, None, None)] {{(pid=117973) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:39:36.435828 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-1838a64a-b537-4411-a936-6e27a8e1b45e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Flavor limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:39:36.436291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-1838a64a-b537-4411-a936-6e27a8e1b45e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Image limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:39:36.436819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-1838a64a-b537-4411-a936-6e27a8e1b45e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Flavor pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:39:36.437317 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-1838a64a-b537-4411-a936-6e27a8e1b45e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Image pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:39:36.437744 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-1838a64a-b537-4411-a936-6e27a8e1b45e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:39:36.447259 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1838a64a-b537-4411-a936-6e27a8e1b45e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:36.447742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1838a64a-b537-4411-a936-6e27a8e1b45e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:36.448559 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1838a64a-b537-4411-a936-6e27a8e1b45e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:36.449044 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1838a64a-b537-4411-a936-6e27a8e1b45e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:36.465978 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-1838a64a-b537-4411-a936-6e27a8e1b45e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Getting quotas for project 8fbd7396d6be4ec28f8df7c62b20d10b. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:39:36.469870 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-1838a64a-b537-4411-a936-6e27a8e1b45e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Getting quotas for user 434463d55cee4e25a2b0b4c70bded44e and project 8fbd7396d6be4ec28f8df7c62b20d10b. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:39:36.483098 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-1838a64a-b537-4411-a936-6e27a8e1b45e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Going to run 1 instances... {{(pid=117973) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:39:36.485384 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-1838a64a-b537-4411-a936-6e27a8e1b45e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='807d39e3-2293-48ca-b2cd-675f7c931014',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:39:36.531362 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1838a64a-b537-4411-a936-6e27a8e1b45e tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485471 May 23 15:39:36.532012 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 497/1008] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:39:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:39:36.542779 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5db3ee41-669f-4653-9d93-56ac85d50d49 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:36.543484 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-5db3ee41-669f-4653-9d93-56ac85d50d49 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:39:36.606958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-5db3ee41-669f-4653-9d93-56ac85d50d49 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:39:36.613919 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5db3ee41-669f-4653-9d93-56ac85d50d49 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00" status: 200 len: 1219 microversion: 2.1 time: 0.075032 May 23 15:39:36.614562 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 512/1009] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:39:36 2022] GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:39:37.631259 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-4196f86b-c411-431d-9313-8241883dc8e7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:37.632054 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-4196f86b-c411-431d-9313-8241883dc8e7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:39:37.639398 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4196f86b-c411-431d-9313-8241883dc8e7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:37.640151 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4196f86b-c411-431d-9313-8241883dc8e7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:37.641200 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4196f86b-c411-431d-9313-8241883dc8e7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:37.641884 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4196f86b-c411-431d-9313-8241883dc8e7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:37.729679 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-4196f86b-c411-431d-9313-8241883dc8e7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:39:37.737261 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-4196f86b-c411-431d-9313-8241883dc8e7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00" status: 200 len: 1289 microversion: 2.1 time: 0.110073 May 23 15:39:37.737832 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 498/1010] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:39:37 2022] GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00 => generated 1289 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:39:38.754690 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e1e2fe39-f71b-4387-9577-140ff11cf955 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:38.755319 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e1e2fe39-f71b-4387-9577-140ff11cf955 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:39:38.757822 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:38.765661 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e1e2fe39-f71b-4387-9577-140ff11cf955 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:38.766115 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e1e2fe39-f71b-4387-9577-140ff11cf955 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:38.766898 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e1e2fe39-f71b-4387-9577-140ff11cf955 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:38.767339 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e1e2fe39-f71b-4387-9577-140ff11cf955 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:38.900761 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e1e2fe39-f71b-4387-9577-140ff11cf955 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:39:38.908483 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e1e2fe39-f71b-4387-9577-140ff11cf955 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00" status: 200 len: 1319 microversion: 2.1 time: 0.157712 May 23 15:39:38.909314 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 513/1011] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:39:38 2022] GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:39:38.960003 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-fe8880b4-f027-442a-ae65-29aa492beb61 req-ab90c2a3-969b-4f96-ab83-3b42335f3df3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "527e759c-541b-46fb-aa31-c80210ce4c00", "tag": "26112dd9-24d4-46a9-9966-ac86ac96bf94"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:39:38.969070 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-fe8880b4-f027-442a-ae65-29aa492beb61 req-ab90c2a3-969b-4f96-ab83-3b42335f3df3 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:38.969709 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-fe8880b4-f027-442a-ae65-29aa492beb61 req-ab90c2a3-969b-4f96-ab83-3b42335f3df3 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:38.982019 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-fe8880b4-f027-442a-ae65-29aa492beb61 req-ab90c2a3-969b-4f96-ab83-3b42335f3df3 service nova] Creating event network-changed:26112dd9-24d4-46a9-9966-ac86ac96bf94 for instance 527e759c-541b-46fb-aa31-c80210ce4c00 on hv-cinder-84112 May 23 15:39:38.986764 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-fe8880b4-f027-442a-ae65-29aa492beb61 req-ab90c2a3-969b-4f96-ab83-3b42335f3df3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031521 May 23 15:39:38.987374 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 499/1012] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:39:39.926610 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-26fa5b92-0086-4ea1-b30e-674692058f42 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:39.927233 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-26fa5b92-0086-4ea1-b30e-674692058f42 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:39:39.934433 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-26fa5b92-0086-4ea1-b30e-674692058f42 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:39.934891 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-26fa5b92-0086-4ea1-b30e-674692058f42 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:39.935666 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-26fa5b92-0086-4ea1-b30e-674692058f42 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:39.936108 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-26fa5b92-0086-4ea1-b30e-674692058f42 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:40.065472 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-26fa5b92-0086-4ea1-b30e-674692058f42 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:39:40.073146 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-26fa5b92-0086-4ea1-b30e-674692058f42 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00" status: 200 len: 1319 microversion: 2.1 time: 0.150534 May 23 15:39:40.073742 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 514/1013] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:39:39 2022] GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:39:41.091910 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5662c46c-5808-4cf6-8277-867f00542b1f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:41.092652 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-5662c46c-5808-4cf6-8277-867f00542b1f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:39:41.099128 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5662c46c-5808-4cf6-8277-867f00542b1f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:41.100298 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5662c46c-5808-4cf6-8277-867f00542b1f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:41.101106 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5662c46c-5808-4cf6-8277-867f00542b1f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:41.101560 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5662c46c-5808-4cf6-8277-867f00542b1f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:41.228613 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-5662c46c-5808-4cf6-8277-867f00542b1f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:39:41.236144 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-5662c46c-5808-4cf6-8277-867f00542b1f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00" status: 200 len: 1319 microversion: 2.1 time: 0.148915 May 23 15:39:41.236721 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 500/1014] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:39:41 2022] GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:39:42.252142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-56812a23-6776-4f73-b38d-26745df0240f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:42.252760 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-56812a23-6776-4f73-b38d-26745df0240f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:39:42.260201 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-56812a23-6776-4f73-b38d-26745df0240f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:42.260895 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-56812a23-6776-4f73-b38d-26745df0240f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:42.261684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-56812a23-6776-4f73-b38d-26745df0240f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:42.262729 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-56812a23-6776-4f73-b38d-26745df0240f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:42.398622 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-56812a23-6776-4f73-b38d-26745df0240f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:39:42.406149 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-56812a23-6776-4f73-b38d-26745df0240f tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00" status: 200 len: 1319 microversion: 2.1 time: 0.157928 May 23 15:39:42.406726 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 515/1015] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:39:42 2022] GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:39:43.424072 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ca7bb81d-a804-4624-9a67-3a004cd88343 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:43.424685 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ca7bb81d-a804-4624-9a67-3a004cd88343 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:39:43.431242 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ca7bb81d-a804-4624-9a67-3a004cd88343 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:43.431692 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ca7bb81d-a804-4624-9a67-3a004cd88343 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:43.432455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ca7bb81d-a804-4624-9a67-3a004cd88343 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:43.432916 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ca7bb81d-a804-4624-9a67-3a004cd88343 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:43.564005 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ca7bb81d-a804-4624-9a67-3a004cd88343 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:39:43.572533 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ca7bb81d-a804-4624-9a67-3a004cd88343 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00" status: 200 len: 1319 microversion: 2.1 time: 0.152079 May 23 15:39:43.573152 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 501/1016] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:39:43 2022] GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:39:44.248941 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-a0ab6252-6cec-4e80-a9d1-3f734a2213b7 req-c35e0ac1-c43c-41bf-a2e0-01733632b7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527e759c-541b-46fb-aa31-c80210ce4c00", "name": "network-vif-plugged", "status": "completed", "tag": "26112dd9-24d4-46a9-9966-ac86ac96bf94"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:39:44.259208 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-a0ab6252-6cec-4e80-a9d1-3f734a2213b7 req-c35e0ac1-c43c-41bf-a2e0-01733632b7f5 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:44.259658 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-a0ab6252-6cec-4e80-a9d1-3f734a2213b7 req-c35e0ac1-c43c-41bf-a2e0-01733632b7f5 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:44.271732 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-a0ab6252-6cec-4e80-a9d1-3f734a2213b7 req-c35e0ac1-c43c-41bf-a2e0-01733632b7f5 service nova] Creating event network-vif-plugged:26112dd9-24d4-46a9-9966-ac86ac96bf94 for instance 527e759c-541b-46fb-aa31-c80210ce4c00 on hv-cinder-84112 May 23 15:39:44.276631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-a0ab6252-6cec-4e80-a9d1-3f734a2213b7 req-c35e0ac1-c43c-41bf-a2e0-01733632b7f5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031459 May 23 15:39:44.277251 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 516/1017] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:39:44.589829 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-bf0d4d35-00f0-4a59-9e92-fbd5d34077da tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:44.590455 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-bf0d4d35-00f0-4a59-9e92-fbd5d34077da tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:39:44.597089 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bf0d4d35-00f0-4a59-9e92-fbd5d34077da tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:44.597620 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bf0d4d35-00f0-4a59-9e92-fbd5d34077da tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:44.598403 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bf0d4d35-00f0-4a59-9e92-fbd5d34077da tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:44.598848 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bf0d4d35-00f0-4a59-9e92-fbd5d34077da tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:44.730412 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-bf0d4d35-00f0-4a59-9e92-fbd5d34077da tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:39:44.737953 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-bf0d4d35-00f0-4a59-9e92-fbd5d34077da tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00" status: 200 len: 1319 microversion: 2.1 time: 0.151949 May 23 15:39:44.738462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 502/1018] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:39:44 2022] GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:39:45.755738 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-1acd59a4-0d80-4f16-a0f1-6b627fb914b8 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:45.756549 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-1acd59a4-0d80-4f16-a0f1-6b627fb914b8 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:39:45.763229 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1acd59a4-0d80-4f16-a0f1-6b627fb914b8 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:45.763630 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1acd59a4-0d80-4f16-a0f1-6b627fb914b8 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:45.764399 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1acd59a4-0d80-4f16-a0f1-6b627fb914b8 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:45.764842 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-1acd59a4-0d80-4f16-a0f1-6b627fb914b8 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:45.894368 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-1acd59a4-0d80-4f16-a0f1-6b627fb914b8 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:39:45.902559 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-1acd59a4-0d80-4f16-a0f1-6b627fb914b8 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00" status: 200 len: 1319 microversion: 2.1 time: 0.151172 May 23 15:39:45.903125 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 517/1019] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:39:45 2022] GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:39:46.921051 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f92a6c8d-ade1-4854-b9b1-1134cfcc50c3 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:46.921677 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f92a6c8d-ade1-4854-b9b1-1134cfcc50c3 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:39:46.924072 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:46.924742 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=6 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:46.933610 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f92a6c8d-ade1-4854-b9b1-1134cfcc50c3 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:46.934068 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f92a6c8d-ade1-4854-b9b1-1134cfcc50c3 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:46.934870 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f92a6c8d-ade1-4854-b9b1-1134cfcc50c3 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:46.935312 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f92a6c8d-ade1-4854-b9b1-1134cfcc50c3 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:47.222778 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f92a6c8d-ade1-4854-b9b1-1134cfcc50c3 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:39:47.230884 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f92a6c8d-ade1-4854-b9b1-1134cfcc50c3 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00" status: 200 len: 1509 microversion: 2.1 time: 0.313833 May 23 15:39:47.231458 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 503/1020] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:39:46 2022] GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00 => generated 1509 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:39:47.247521 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-6cf0fa89-632c-4ec6-bfc4-506d26bdbfca tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f3b20f2-dfcc-490c-aada-ec63492b680d", "device": "/dev/sdb"}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:39:47.249107 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-6cf0fa89-632c-4ec6-bfc4-506d26bdbfca tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:39:47.251082 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=2 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:47.257304 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6cf0fa89-632c-4ec6-bfc4-506d26bdbfca tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:47.257754 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6cf0fa89-632c-4ec6-bfc4-506d26bdbfca tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:47.258518 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6cf0fa89-632c-4ec6-bfc4-506d26bdbfca tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:47.258957 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6cf0fa89-632c-4ec6-bfc4-506d26bdbfca tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:47.506635 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-6cf0fa89-632c-4ec6-bfc4-506d26bdbfca tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "POST /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262078 May 23 15:39:47.511939 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 518/1021] 10.222.0.30 () {60 vars in 1322 bytes} [Mon May 23 15:39:47 2022] POST /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:40:04.469459 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:40:04.470106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Mon May 23 15:40:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:40:05.768158 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7ba289ff-bed5-4bd7-af08-d24a2e372f9d tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:05.768693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7ba289ff-bed5-4bd7-af08-d24a2e372f9d tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:05.770840 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:40:05.771638 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:40:05.778108 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7ba289ff-bed5-4bd7-af08-d24a2e372f9d tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:05.778569 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7ba289ff-bed5-4bd7-af08-d24a2e372f9d tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:05.779344 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7ba289ff-bed5-4bd7-af08-d24a2e372f9d tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:05.779793 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7ba289ff-bed5-4bd7-af08-d24a2e372f9d tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:05.861800 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.objects.instance [None req-7ba289ff-bed5-4bd7-af08-d24a2e372f9d tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lazy-loading 'services' on Instance uuid 527e759c-541b-46fb-aa31-c80210ce4c00 {{(pid=117973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:40:05.932244 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7ba289ff-bed5-4bd7-af08-d24a2e372f9d tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "DELETE /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00/os-volume_attachments/9f3b20f2-dfcc-490c-aada-ec63492b680d" status: 202 len: 0 microversion: 2.1 time: 0.167804 May 23 15:40:05.932839 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 504/1022] 10.222.0.30 () {58 vars in 1415 bytes} [Mon May 23 15:40:05 2022] DELETE /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00/os-volume_attachments/9f3b20f2-dfcc-490c-aada-ec63492b680d => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:40:07.044669 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-17d0191d-dc45-4178-beec-b1a8ad5b2d7a tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:07.045302 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-17d0191d-dc45-4178-beec-b1a8ad5b2d7a tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:07.047827 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=24 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:40:07.048608 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:40:07.054972 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-17d0191d-dc45-4178-beec-b1a8ad5b2d7a tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:07.055424 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-17d0191d-dc45-4178-beec-b1a8ad5b2d7a tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:07.056194 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-17d0191d-dc45-4178-beec-b1a8ad5b2d7a tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:07.056633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-17d0191d-dc45-4178-beec-b1a8ad5b2d7a tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:07.081888 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-17d0191d-dc45-4178-beec-b1a8ad5b2d7a tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Going to try to terminate instance {{(pid=117974) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:40:07.155125 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-17d0191d-dc45-4178-beec-b1a8ad5b2d7a tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "DELETE /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00" status: 204 len: 0 microversion: 2.1 time: 0.115056 May 23 15:40:07.155812 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 519/1023] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:40:07 2022] DELETE /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:40:07.165575 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f6b4ed4a-17fd-45f1-8ed8-e20460456db4 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:07.166289 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f6b4ed4a-17fd-45f1-8ed8-e20460456db4 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:07.173188 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f6b4ed4a-17fd-45f1-8ed8-e20460456db4 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:07.173673 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f6b4ed4a-17fd-45f1-8ed8-e20460456db4 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:07.174449 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f6b4ed4a-17fd-45f1-8ed8-e20460456db4 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:07.174896 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f6b4ed4a-17fd-45f1-8ed8-e20460456db4 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:07.307036 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f6b4ed4a-17fd-45f1-8ed8-e20460456db4 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:40:07.314632 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f6b4ed4a-17fd-45f1-8ed8-e20460456db4 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00" status: 200 len: 1515 microversion: 2.1 time: 0.154143 May 23 15:40:07.315205 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 505/1024] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:07 2022] GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:40:08.332705 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2b75cecb-8fa2-43fe-ac05-f7d6dbf9f4ef tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:08.333363 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-2b75cecb-8fa2-43fe-ac05-f7d6dbf9f4ef tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:08.340549 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2b75cecb-8fa2-43fe-ac05-f7d6dbf9f4ef tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:08.341034 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2b75cecb-8fa2-43fe-ac05-f7d6dbf9f4ef tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:08.341814 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2b75cecb-8fa2-43fe-ac05-f7d6dbf9f4ef tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:08.342285 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2b75cecb-8fa2-43fe-ac05-f7d6dbf9f4ef tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:08.528423 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-2b75cecb-8fa2-43fe-ac05-f7d6dbf9f4ef tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:40:08.536142 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-2b75cecb-8fa2-43fe-ac05-f7d6dbf9f4ef tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00" status: 200 len: 1515 microversion: 2.1 time: 0.207840 May 23 15:40:08.536974 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 520/1025] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:08 2022] GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00 => generated 1515 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:40:09.494311 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-f0f40005-4475-4efe-89f5-6819f59a2e71 req-9a40de88-1841-406c-b787-3ceb2866061c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527e759c-541b-46fb-aa31-c80210ce4c00", "name": "network-vif-deleted", "tag": "26112dd9-24d4-46a9-9966-ac86ac96bf94"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:40:09.506788 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-f0f40005-4475-4efe-89f5-6819f59a2e71 req-9a40de88-1841-406c-b787-3ceb2866061c service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:09.507238 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-f0f40005-4475-4efe-89f5-6819f59a2e71 req-9a40de88-1841-406c-b787-3ceb2866061c service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:09.520691 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-f0f40005-4475-4efe-89f5-6819f59a2e71 req-9a40de88-1841-406c-b787-3ceb2866061c service nova] Creating event network-vif-deleted:26112dd9-24d4-46a9-9966-ac86ac96bf94 for instance 527e759c-541b-46fb-aa31-c80210ce4c00 on hv-cinder-84112 May 23 15:40:09.525551 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-f0f40005-4475-4efe-89f5-6819f59a2e71 req-9a40de88-1841-406c-b787-3ceb2866061c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035359 May 23 15:40:09.526393 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 506/1026] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:40:09.554194 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-2c67a503-98c5-4f1f-b143-a82eb6396925 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:09.554803 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-2c67a503-98c5-4f1f-b143-a82eb6396925 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:09.562011 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2c67a503-98c5-4f1f-b143-a82eb6396925 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:09.562469 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2c67a503-98c5-4f1f-b143-a82eb6396925 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:09.563247 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2c67a503-98c5-4f1f-b143-a82eb6396925 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:09.563688 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-2c67a503-98c5-4f1f-b143-a82eb6396925 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:09.627488 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-2c67a503-98c5-4f1f-b143-a82eb6396925 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434463d55cee4e25a2b0b4c70bded44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbd7396d6be4ec28f8df7c62b20d10b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:40:09.635058 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-2c67a503-98c5-4f1f-b143-a82eb6396925 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00" status: 200 len: 1304 microversion: 2.1 time: 0.084947 May 23 15:40:09.635621 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 521/1027] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:09 2022] GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00 => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:40:10.652558 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-e90a57d3-cb6b-493e-80e5-44d4e1bee5f7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:10.653290 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-e90a57d3-cb6b-493e-80e5-44d4e1bee5f7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] [instance: 527e759c-541b-46fb-aa31-c80210ce4c00] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:10.659712 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e90a57d3-cb6b-493e-80e5-44d4e1bee5f7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:10.660159 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e90a57d3-cb6b-493e-80e5-44d4e1bee5f7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:10.660966 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e90a57d3-cb6b-493e-80e5-44d4e1bee5f7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:10.661406 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-e90a57d3-cb6b-493e-80e5-44d4e1bee5f7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:10.674802 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-e90a57d3-cb6b-493e-80e5-44d4e1bee5f7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] HTTP exception thrown: Instance 527e759c-541b-46fb-aa31-c80210ce4c00 could not be found. May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-e90a57d3-cb6b-493e-80e5-44d4e1bee5f7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Request method failure captured: May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00 HTTP/1.1 May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6pyY4-VHk2H5asgdBSIEBc87sCUqiAcG-xwaEgr9BAgG1zf0yEHEAXGNWCL-POsV-_FqXDQx76D7z8T2n5axgYfq3wZ9zcG4P5ki9jRSssjyC-cxbgkCjpyeHrtE7Huq_P9h0ZELbOpquBDphcjFqvsanNgIhATTrh9bydzLyVd21Q May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: 8fbd7396d6be4ec28f8df7c62b20d10b May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-VolumesSnapshotTestJSON-278806103 May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:40:10.676405 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:40:10.678131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8fbd7396d6be4ec28f8df7c62b20d10b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8fbd7396d6be4ec28f8df7c62b20d10b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8fbd7396d6be4ec28f8df7c62b20d10b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8fbd7396d6be4ec28f8df7c62b20d10b", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:40:10.678131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-VolumesSnapshotTestJSON-278806103 May 23 15:40:10.678131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: 8fbd7396d6be4ec28f8df7c62b20d10b May 23 15:40:10.678131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-278806103 May 23 15:40:10.678131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-VolumesSnapshotTestJSON-278806103-project May 23 15:40:10.678131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:40:10.678131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:40:10.678131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: 434463d55cee4e25a2b0b4c70bded44e May 23 15:40:10.678131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-VolumesSnapshotTestJSON-278806103-project May 23 15:40:10.678131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:40:10.678131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance 527e759c-541b-46fb-aa31-c80210ce4c00 could not be found. May 23 15:40:10.678131 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': '527e759c-541b-46fb-aa31-c80210ce4c00'} May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 527e759c-541b-46fb-aa31-c80210ce4c00 could not be found. May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:40:10.679095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 527e759c-541b-46fb-aa31-c80210ce4c00 could not be found. May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 527e759c-541b-46fb-aa31-c80210ce4c00 could not be found. May 23 15:40:10.680672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:40:10.682048 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-e90a57d3-cb6b-493e-80e5-44d4e1bee5f7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] Returning 404 to user: Instance 527e759c-541b-46fb-aa31-c80210ce4c00 could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:40:10.682048 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-e90a57d3-cb6b-493e-80e5-44d4e1bee5f7 tempest-VolumesSnapshotTestJSON-278806103 tempest-VolumesSnapshotTestJSON-278806103-project] 10.222.0.30 "GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00" status: 404 len: 111 microversion: 2.1 time: 0.029979 May 23 15:40:10.682048 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 507/1028] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:10 2022] GET /compute/v2.1/servers/527e759c-541b-46fb-aa31-c80210ce4c00 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:40:43.738540 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:40:43.739711 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:40:43.913145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-95a71d95-244e-4ae4-9033-3afcfef10ebc tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Action: 'create', calling method: .version_select at 0x7f0d7a5a09d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1488814699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfx4eBt2UNvWcPM4P1sTy7iuq5cOp8SP7ClND8/y/sEC7zP4Wu1qPpxUBm7PZiWiGOegyEceKyUh0xrjUkTHVFxsAUv5nBFllnYXYmLFd+sDE9pZ1wuhxF08hwq1xIh+g=="}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:40:43.927956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-95a71d95-244e-4ae4-9033-3afcfef10ebc tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Getting quotas for project fe810dde94644f57b3b6262366c8f126. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:40:43.931832 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-95a71d95-244e-4ae4-9033-3afcfef10ebc tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Getting quotas for user aec46cf4f87241a2a4581e34c154f5a8 and project fe810dde94644f57b3b6262366c8f126. Resources: {'key_pairs'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:40:43.960745 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-95a71d95-244e-4ae4-9033-3afcfef10ebc tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.227334 May 23 15:40:43.961844 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 522/1029] 10.222.0.30 () {60 vars in 1158 bytes} [Mon May 23 15:40:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:40:44.208166 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7cc60e82-1058-460d-807b-23fa9c02ab58 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:44.208691 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7cc60e82-1058-460d-807b-23fa9c02ab58 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:44.212267 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=8 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:40:44.214564 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:40:44.224094 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7cc60e82-1058-460d-807b-23fa9c02ab58 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:44.225154 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7cc60e82-1058-460d-807b-23fa9c02ab58 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:44.227996 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7cc60e82-1058-460d-807b-23fa9c02ab58 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:44.228752 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7cc60e82-1058-460d-807b-23fa9c02ab58 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:44.261800 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7cc60e82-1058-460d-807b-23fa9c02ab58 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Going to try to terminate instance {{(pid=117973) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:40:44.369207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7cc60e82-1058-460d-807b-23fa9c02ab58 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 204 len: 0 microversion: 2.1 time: 0.163882 May 23 15:40:44.370054 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 508/1030] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:40:44 2022] DELETE /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:40:44.379974 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-c4598f2f-39ef-4642-9c30-6fc4c4a69714 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:44.380601 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-c4598f2f-39ef-4642-9c30-6fc4c4a69714 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:44.388931 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c4598f2f-39ef-4642-9c30-6fc4c4a69714 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:44.389428 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c4598f2f-39ef-4642-9c30-6fc4c4a69714 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:44.390400 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c4598f2f-39ef-4642-9c30-6fc4c4a69714 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:44.391019 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-c4598f2f-39ef-4642-9c30-6fc4c4a69714 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:44.562013 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-c4598f2f-39ef-4642-9c30-6fc4c4a69714 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:40:44.570706 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-c4598f2f-39ef-4642-9c30-6fc4c4a69714 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1578 microversion: 2.1 time: 0.194648 May 23 15:40:44.571911 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 523/1031] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:44 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1578 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:40:45.590729 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-fcd7544a-fba5-48c2-a4d5-f7c09b7412fd tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:45.591532 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-fcd7544a-fba5-48c2-a4d5-f7c09b7412fd tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:45.598065 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fcd7544a-fba5-48c2-a4d5-f7c09b7412fd tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:45.598514 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fcd7544a-fba5-48c2-a4d5-f7c09b7412fd tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:45.599278 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fcd7544a-fba5-48c2-a4d5-f7c09b7412fd tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:45.599714 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-fcd7544a-fba5-48c2-a4d5-f7c09b7412fd tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:45.748971 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-fcd7544a-fba5-48c2-a4d5-f7c09b7412fd tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:40:45.757095 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-fcd7544a-fba5-48c2-a4d5-f7c09b7412fd tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1578 microversion: 2.1 time: 0.170620 May 23 15:40:45.758207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 509/1032] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:45 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:40:46.774018 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-691ddf24-8149-4e4b-ac6b-7cc2cbc34c07 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:46.774720 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-691ddf24-8149-4e4b-ac6b-7cc2cbc34c07 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:46.783316 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-691ddf24-8149-4e4b-ac6b-7cc2cbc34c07 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:46.785587 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-691ddf24-8149-4e4b-ac6b-7cc2cbc34c07 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:46.786801 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-691ddf24-8149-4e4b-ac6b-7cc2cbc34c07 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:46.787248 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-691ddf24-8149-4e4b-ac6b-7cc2cbc34c07 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:46.939916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-691ddf24-8149-4e4b-ac6b-7cc2cbc34c07 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:40:46.948542 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-691ddf24-8149-4e4b-ac6b-7cc2cbc34c07 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1578 microversion: 2.1 time: 0.178719 May 23 15:40:46.949303 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 524/1033] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:46 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:40:47.311384 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-e8f60f40-137d-4f00-a1ce-05af26025b63 req-c8f06d03-6b5e-4438-a64b-b3ba48f0fa35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3cec2db-2c9e-4056-91b1-e16f4981811c", "name": "network-vif-deleted", "tag": "9ec6265e-1a00-4a72-a184-cf3c6c301c06"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:40:47.340145 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-e8f60f40-137d-4f00-a1ce-05af26025b63 req-c8f06d03-6b5e-4438-a64b-b3ba48f0fa35 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:47.342804 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-e8f60f40-137d-4f00-a1ce-05af26025b63 req-c8f06d03-6b5e-4438-a64b-b3ba48f0fa35 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:47.363501 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-e8f60f40-137d-4f00-a1ce-05af26025b63 req-c8f06d03-6b5e-4438-a64b-b3ba48f0fa35 service nova] Creating event network-vif-deleted:9ec6265e-1a00-4a72-a184-cf3c6c301c06 for instance d3cec2db-2c9e-4056-91b1-e16f4981811c on hv-cinder-84112 May 23 15:40:47.369783 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-e8f60f40-137d-4f00-a1ce-05af26025b63 req-c8f06d03-6b5e-4438-a64b-b3ba48f0fa35 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073963 May 23 15:40:47.370522 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 510/1034] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:40:47.967787 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-983abfd4-67a4-4254-9e9f-fb6e0c7a45cc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:47.968375 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-983abfd4-67a4-4254-9e9f-fb6e0c7a45cc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:47.975451 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-983abfd4-67a4-4254-9e9f-fb6e0c7a45cc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:47.975897 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-983abfd4-67a4-4254-9e9f-fb6e0c7a45cc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:47.976704 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-983abfd4-67a4-4254-9e9f-fb6e0c7a45cc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:47.977174 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-983abfd4-67a4-4254-9e9f-fb6e0c7a45cc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:48.014496 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-983abfd4-67a4-4254-9e9f-fb6e0c7a45cc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:48.014975 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-983abfd4-67a4-4254-9e9f-fb6e0c7a45cc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:48.015445 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-983abfd4-67a4-4254-9e9f-fb6e0c7a45cc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lazy-loading 'fault' on Instance uuid d3cec2db-2c9e-4056-91b1-e16f4981811c {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:40:48.064633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-983abfd4-67a4-4254-9e9f-fb6e0c7a45cc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:40:48.073702 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-983abfd4-67a4-4254-9e9f-fb6e0c7a45cc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 200 len: 1230 microversion: 2.1 time: 0.110867 May 23 15:40:48.074405 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 525/1035] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:47 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 1230 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:40:49.092105 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-028a9c76-3703-4e57-a24d-6a98c8001f29 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:49.092801 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-028a9c76-3703-4e57-a24d-6a98c8001f29 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:49.099852 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-028a9c76-3703-4e57-a24d-6a98c8001f29 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:49.100338 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-028a9c76-3703-4e57-a24d-6a98c8001f29 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:49.101167 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-028a9c76-3703-4e57-a24d-6a98c8001f29 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:49.101629 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-028a9c76-3703-4e57-a24d-6a98c8001f29 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:49.116189 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-028a9c76-3703-4e57-a24d-6a98c8001f29 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] HTTP exception thrown: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-028a9c76-3703-4e57-a24d-6a98c8001f29 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Request method failure captured: May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c HTTP/1.1 May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6pPFnhlP44DlfuZrn540KEsk_GxJuq9-d_HlUj6EEkhA-bQLGUE7ndnaGOKCmgc4xgLds2HqsgLwPEmSOPp_FU5I-qmEQbzOcp36wyR06FFOjH7CrEFM21bcouHIAFcSL0REveSkVwh-kctrNivJ0yFWMwYK8Zen5BZJOgYoslrHQo May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: 449514f02fbc485484110bde5a2018c0 May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-TestVolumeBootPattern-1083421479 May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:40:49.117853 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:40:49.119562 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/449514f02fbc485484110bde5a2018c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/449514f02fbc485484110bde5a2018c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/449514f02fbc485484110bde5a2018c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_449514f02fbc485484110bde5a2018c0", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:40:49.119562 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-TestVolumeBootPattern-1083421479 May 23 15:40:49.119562 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: 449514f02fbc485484110bde5a2018c0 May 23 15:40:49.119562 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-TestVolumeBootPattern-1083421479 May 23 15:40:49.119562 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-TestVolumeBootPattern-1083421479-project May 23 15:40:49.119562 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:40:49.119562 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:40:49.119562 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: 01d7c2fa381541139ea7aebaf2ae688f May 23 15:40:49.119562 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-TestVolumeBootPattern-1083421479-project May 23 15:40:49.119562 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:40:49.119562 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. May 23 15:40:49.119562 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': 'd3cec2db-2c9e-4056-91b1-e16f4981811c'} May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:40:49.120574 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. May 23 15:40:49.122792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:40:49.124171 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-028a9c76-3703-4e57-a24d-6a98c8001f29 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Returning 404 to user: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:40:49.124171 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-028a9c76-3703-4e57-a24d-6a98c8001f29 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 404 len: 111 microversion: 2.1 time: 0.031418 May 23 15:40:49.124171 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 511/1036] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:49 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:40:49.218882 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e36c28ad-981c-47e4-8561-eeed0fc9c35c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1147122038", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1729280906", "security_groups": [{"name": "tempest-secgroup-smoke-1491515110"}], "block_device_mapping_v2": [{"uuid": "5ec1fb57-856a-46b2-94df-8734fb62cf8e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ca014fd-aa0f-4216-ae7a-a155fcb74406"}]}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:40:49.335716 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.network.neutron [None req-e36c28ad-981c-47e4-8561-eeed0fc9c35c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] validate_networks() for [('5ca014fd-aa0f-4216-ae7a-a155fcb74406', None, None, None, None, None)] {{(pid=117974) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:40:49.853466 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-e36c28ad-981c-47e4-8561-eeed0fc9c35c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Flavor limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:40:49.853892 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-e36c28ad-981c-47e4-8561-eeed0fc9c35c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Image limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:40:49.854367 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-e36c28ad-981c-47e4-8561-eeed0fc9c35c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Flavor pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:40:49.854776 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-e36c28ad-981c-47e4-8561-eeed0fc9c35c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Image pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:40:49.855185 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-e36c28ad-981c-47e4-8561-eeed0fc9c35c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:40:49.864755 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e36c28ad-981c-47e4-8561-eeed0fc9c35c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:49.865241 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e36c28ad-981c-47e4-8561-eeed0fc9c35c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:49.866035 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e36c28ad-981c-47e4-8561-eeed0fc9c35c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:49.866676 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e36c28ad-981c-47e4-8561-eeed0fc9c35c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:49.883659 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-e36c28ad-981c-47e4-8561-eeed0fc9c35c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Getting quotas for project 449514f02fbc485484110bde5a2018c0. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:40:49.887657 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-e36c28ad-981c-47e4-8561-eeed0fc9c35c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Getting quotas for user 01d7c2fa381541139ea7aebaf2ae688f and project 449514f02fbc485484110bde5a2018c0. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:40:49.946601 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e36c28ad-981c-47e4-8561-eeed0fc9c35c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Going to run 1 instances... {{(pid=117974) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:40:49.948671 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e36c28ad-981c-47e4-8561-eeed0fc9c35c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ec1fb57-856a-46b2-94df-8734fb62cf8e',volume_size=None,volume_type=None)] {{(pid=117974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:40:50.107108 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e36c28ad-981c-47e4-8561-eeed0fc9c35c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.891490 May 23 15:40:50.107773 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 526/1037] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:40:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:40:50.117618 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a5048840-0e07-4c4a-a130-e4102e858cd3 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:50.118244 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-a5048840-0e07-4c4a-a130-e4102e858cd3 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:50.178224 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a5048840-0e07-4c4a-a130-e4102e858cd3 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:40:50.187279 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a5048840-0e07-4c4a-a130-e4102e858cd3 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d" status: 200 len: 1095 microversion: 2.1 time: 0.073364 May 23 15:40:50.188357 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 512/1038] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:50 2022] GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:40:51.205018 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d1f47632-09d2-429b-9552-4612b3867d00 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:51.205667 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d1f47632-09d2-429b-9552-4612b3867d00 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:51.212020 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d1f47632-09d2-429b-9552-4612b3867d00 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:51.212477 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d1f47632-09d2-429b-9552-4612b3867d00 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:51.213286 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d1f47632-09d2-429b-9552-4612b3867d00 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:51.213731 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-d1f47632-09d2-429b-9552-4612b3867d00 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:51.284306 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d1f47632-09d2-429b-9552-4612b3867d00 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:40:51.292321 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d1f47632-09d2-429b-9552-4612b3867d00 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d" status: 200 len: 1201 microversion: 2.1 time: 0.092540 May 23 15:40:51.292914 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 527/1039] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:51 2022] GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d => generated 1201 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:40:52.310942 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ff0447b7-1d2e-4f97-b20e-9c05cce2f0b0 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:52.311595 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ff0447b7-1d2e-4f97-b20e-9c05cce2f0b0 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:52.318255 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ff0447b7-1d2e-4f97-b20e-9c05cce2f0b0 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:52.318712 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ff0447b7-1d2e-4f97-b20e-9c05cce2f0b0 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:52.319522 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ff0447b7-1d2e-4f97-b20e-9c05cce2f0b0 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:52.319963 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ff0447b7-1d2e-4f97-b20e-9c05cce2f0b0 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:52.535373 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ff0447b7-1d2e-4f97-b20e-9c05cce2f0b0 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:40:52.543486 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ff0447b7-1d2e-4f97-b20e-9c05cce2f0b0 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d" status: 200 len: 1267 microversion: 2.1 time: 0.236871 May 23 15:40:52.544699 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 513/1040] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:52 2022] GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:40:52.889311 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-6379e8b3-29fc-46e4-a0bf-3009b19f26e1 req-57b2e2e8-c01a-4d99-a8f7-93c53a0cb24c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca2fa96-252e-4d26-87eb-74cee3ee6c7d", "tag": "0a916c19-f60f-4185-8d5c-62020d7bdb15"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:40:52.899262 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-6379e8b3-29fc-46e4-a0bf-3009b19f26e1 req-57b2e2e8-c01a-4d99-a8f7-93c53a0cb24c service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:52.899942 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-6379e8b3-29fc-46e4-a0bf-3009b19f26e1 req-57b2e2e8-c01a-4d99-a8f7-93c53a0cb24c service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:52.932190 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-6379e8b3-29fc-46e4-a0bf-3009b19f26e1 req-57b2e2e8-c01a-4d99-a8f7-93c53a0cb24c service nova] Creating event network-changed:0a916c19-f60f-4185-8d5c-62020d7bdb15 for instance eca2fa96-252e-4d26-87eb-74cee3ee6c7d on hv-cinder-84112 May 23 15:40:52.939365 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-6379e8b3-29fc-46e4-a0bf-3009b19f26e1 req-57b2e2e8-c01a-4d99-a8f7-93c53a0cb24c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054630 May 23 15:40:52.940956 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 528/1041] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:40:53.562005 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-cfc4fcde-b663-4308-b622-d452eb28bd2d tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:53.563274 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-cfc4fcde-b663-4308-b622-d452eb28bd2d tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:53.570142 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cfc4fcde-b663-4308-b622-d452eb28bd2d tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:53.570602 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cfc4fcde-b663-4308-b622-d452eb28bd2d tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:53.571389 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cfc4fcde-b663-4308-b622-d452eb28bd2d tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:53.571863 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cfc4fcde-b663-4308-b622-d452eb28bd2d tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:53.741205 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-cfc4fcde-b663-4308-b622-d452eb28bd2d tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:40:53.750471 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-cfc4fcde-b663-4308-b622-d452eb28bd2d tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d" status: 200 len: 1267 microversion: 2.1 time: 0.192957 May 23 15:40:53.751220 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 514/1042] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:53 2022] GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:40:54.769071 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-3bf0b1b0-f297-4b6f-be2e-191853e30738 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:54.769795 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-3bf0b1b0-f297-4b6f-be2e-191853e30738 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:54.776531 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3bf0b1b0-f297-4b6f-be2e-191853e30738 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:54.777024 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3bf0b1b0-f297-4b6f-be2e-191853e30738 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:54.777805 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3bf0b1b0-f297-4b6f-be2e-191853e30738 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:54.778339 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-3bf0b1b0-f297-4b6f-be2e-191853e30738 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:54.917104 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-3bf0b1b0-f297-4b6f-be2e-191853e30738 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:40:54.925440 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-3bf0b1b0-f297-4b6f-be2e-191853e30738 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d" status: 200 len: 1267 microversion: 2.1 time: 0.161026 May 23 15:40:54.926054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 529/1043] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:54 2022] GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:40:55.945236 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-4332faaa-7393-4446-8b99-2c9429b038f1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:55.945978 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-4332faaa-7393-4446-8b99-2c9429b038f1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:55.952827 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4332faaa-7393-4446-8b99-2c9429b038f1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:55.953323 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4332faaa-7393-4446-8b99-2c9429b038f1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:55.954107 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4332faaa-7393-4446-8b99-2c9429b038f1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:55.954555 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4332faaa-7393-4446-8b99-2c9429b038f1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:56.093898 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-4332faaa-7393-4446-8b99-2c9429b038f1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:40:56.101394 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-4332faaa-7393-4446-8b99-2c9429b038f1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d" status: 200 len: 1267 microversion: 2.1 time: 0.162348 May 23 15:40:56.101959 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 515/1044] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:55 2022] GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:40:57.118152 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4c24fa4a-3854-415f-ab80-6b9786ef2257 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:57.118768 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4c24fa4a-3854-415f-ab80-6b9786ef2257 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:57.126039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c24fa4a-3854-415f-ab80-6b9786ef2257 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:57.126494 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c24fa4a-3854-415f-ab80-6b9786ef2257 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:57.127271 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c24fa4a-3854-415f-ab80-6b9786ef2257 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:57.127711 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4c24fa4a-3854-415f-ab80-6b9786ef2257 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:57.264796 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4c24fa4a-3854-415f-ab80-6b9786ef2257 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:40:57.272801 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4c24fa4a-3854-415f-ab80-6b9786ef2257 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d" status: 200 len: 1267 microversion: 2.1 time: 0.158468 May 23 15:40:57.273558 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 530/1045] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:57 2022] GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:40:58.290578 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7d3fb19b-7007-4079-9a15-f376e0d74c84 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:58.291183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7d3fb19b-7007-4079-9a15-f376e0d74c84 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:58.298432 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7d3fb19b-7007-4079-9a15-f376e0d74c84 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:58.298880 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7d3fb19b-7007-4079-9a15-f376e0d74c84 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:58.299663 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7d3fb19b-7007-4079-9a15-f376e0d74c84 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:58.300084 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7d3fb19b-7007-4079-9a15-f376e0d74c84 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:58.427504 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-7d3fb19b-7007-4079-9a15-f376e0d74c84 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:40:58.435735 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7d3fb19b-7007-4079-9a15-f376e0d74c84 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d" status: 200 len: 1267 microversion: 2.1 time: 0.148724 May 23 15:40:58.436207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 516/1046] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:58 2022] GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:40:58.731589 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-f17c59f3-0cd7-4478-8550-8916da50cdff req-008a89a9-8521-4f65-b253-33d47f3b65ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca2fa96-252e-4d26-87eb-74cee3ee6c7d", "name": "network-vif-plugged", "status": "completed", "tag": "0a916c19-f60f-4185-8d5c-62020d7bdb15"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:40:58.740678 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-f17c59f3-0cd7-4478-8550-8916da50cdff req-008a89a9-8521-4f65-b253-33d47f3b65ba service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:58.741150 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-f17c59f3-0cd7-4478-8550-8916da50cdff req-008a89a9-8521-4f65-b253-33d47f3b65ba service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:58.752251 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-f17c59f3-0cd7-4478-8550-8916da50cdff req-008a89a9-8521-4f65-b253-33d47f3b65ba service nova] Creating event network-vif-plugged:0a916c19-f60f-4185-8d5c-62020d7bdb15 for instance eca2fa96-252e-4d26-87eb-74cee3ee6c7d on hv-cinder-84112 May 23 15:40:58.757186 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-f17c59f3-0cd7-4478-8550-8916da50cdff req-008a89a9-8521-4f65-b253-33d47f3b65ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082672 May 23 15:40:58.757763 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 531/1047] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:40:59.453638 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-df1ce476-b0d3-4b2b-a102-bf75fd9c777f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:40:59.454179 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-df1ce476-b0d3-4b2b-a102-bf75fd9c777f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:40:59.460934 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-df1ce476-b0d3-4b2b-a102-bf75fd9c777f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:59.461452 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-df1ce476-b0d3-4b2b-a102-bf75fd9c777f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:59.462307 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-df1ce476-b0d3-4b2b-a102-bf75fd9c777f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:59.462803 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-df1ce476-b0d3-4b2b-a102-bf75fd9c777f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:59.596127 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-df1ce476-b0d3-4b2b-a102-bf75fd9c777f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:40:59.603719 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-df1ce476-b0d3-4b2b-a102-bf75fd9c777f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d" status: 200 len: 1267 microversion: 2.1 time: 0.154698 May 23 15:40:59.604292 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 517/1048] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:40:59 2022] GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:00.618604 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=2 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:00.619481 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=10 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:00.623760 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-6be232d2-a164-4f9c-a0d8-0ba94b860934 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:00.624479 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-6be232d2-a164-4f9c-a0d8-0ba94b860934 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:00.631794 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6be232d2-a164-4f9c-a0d8-0ba94b860934 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:00.632248 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6be232d2-a164-4f9c-a0d8-0ba94b860934 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:00.633045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6be232d2-a164-4f9c-a0d8-0ba94b860934 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:00.633488 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6be232d2-a164-4f9c-a0d8-0ba94b860934 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:00.767790 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-6be232d2-a164-4f9c-a0d8-0ba94b860934 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:00.775622 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-6be232d2-a164-4f9c-a0d8-0ba94b860934 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d" status: 200 len: 1453 microversion: 2.1 time: 0.158501 May 23 15:41:00.776132 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 532/1049] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:41:00 2022] GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:00.792320 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-a73bacea-804a-49d1-96eb-64c301b9f47f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:00.792960 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-a73bacea-804a-49d1-96eb-64c301b9f47f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:00.795102 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:00.801137 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a73bacea-804a-49d1-96eb-64c301b9f47f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:00.801601 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a73bacea-804a-49d1-96eb-64c301b9f47f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:00.802391 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a73bacea-804a-49d1-96eb-64c301b9f47f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:00.802837 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-a73bacea-804a-49d1-96eb-64c301b9f47f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:00.932509 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-a73bacea-804a-49d1-96eb-64c301b9f47f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:00.940542 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-a73bacea-804a-49d1-96eb-64c301b9f47f tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d" status: 200 len: 1453 microversion: 2.1 time: 0.152415 May 23 15:41:00.941145 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 518/1050] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:41:00 2022] GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:41:01.268428 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b24fdaa2-380a-4462-a14c-53c86b161237 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1359799118", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1488814699", "security_groups": [{"name": "tempest-secgroup-smoke-929607253"}], "networks": [{"uuid": "04207fbb-130e-4d70-a528-326f06ddba5f"}], "block_device_mapping_v2": [{"uuid": "f0a1088c-de32-42b1-afcc-bcfcf6eeeb4f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:41:01.428572 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.network.neutron [None req-b24fdaa2-380a-4462-a14c-53c86b161237 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] validate_networks() for [('04207fbb-130e-4d70-a528-326f06ddba5f', None, None, None, None, None)] {{(pid=117974) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:41:02.065019 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-b24fdaa2-380a-4462-a14c-53c86b161237 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Flavor limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:41:02.065588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-b24fdaa2-380a-4462-a14c-53c86b161237 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Image limits 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:41:02.065928 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-b24fdaa2-380a-4462-a14c-53c86b161237 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Flavor pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:41:02.066348 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-b24fdaa2-380a-4462-a14c-53c86b161237 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Image pref 0:0:0 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:41:02.066770 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.virt.hardware [None req-b24fdaa2-380a-4462-a14c-53c86b161237 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:41:02.075943 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b24fdaa2-380a-4462-a14c-53c86b161237 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:02.076398 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b24fdaa2-380a-4462-a14c-53c86b161237 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:02.077244 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b24fdaa2-380a-4462-a14c-53c86b161237 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:02.077691 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b24fdaa2-380a-4462-a14c-53c86b161237 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:02.095117 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-b24fdaa2-380a-4462-a14c-53c86b161237 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Getting quotas for project fe810dde94644f57b3b6262366c8f126. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:41:02.099208 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.quota [None req-b24fdaa2-380a-4462-a14c-53c86b161237 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Getting quotas for user aec46cf4f87241a2a4581e34c154f5a8 and project fe810dde94644f57b3b6262366c8f126. Resources: {'instances', 'ram', 'cores'} {{(pid=117974) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:41:02.162827 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b24fdaa2-380a-4462-a14c-53c86b161237 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Going to run 1 instances... {{(pid=117974) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:41:02.164979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b24fdaa2-380a-4462-a14c-53c86b161237 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0a1088c-de32-42b1-afcc-bcfcf6eeeb4f',volume_size=None,volume_type=None)] {{(pid=117974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:41:02.299381 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b24fdaa2-380a-4462-a14c-53c86b161237 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.034760 May 23 15:41:02.305454 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 533/1051] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:41:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:41:02.311166 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-fc986048-b015-4e88-8051-1437ad4c9610 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:02.312373 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-fc986048-b015-4e88-8051-1437ad4c9610 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:02.375819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-fc986048-b015-4e88-8051-1437ad4c9610 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:02.391149 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-fc986048-b015-4e88-8051-1437ad4c9610 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1089 microversion: 2.1 time: 0.084219 May 23 15:41:02.402349 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 519/1052] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:41:02 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1089 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:03.229594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-6d73f2bf-b8bc-4954-8967-7e17e5b19868 req-133307c0-08bb-40cd-85c0-b73ebf5c5576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca2fa96-252e-4d26-87eb-74cee3ee6c7d", "tag": "0a916c19-f60f-4185-8d5c-62020d7bdb15"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:41:03.238601 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-6d73f2bf-b8bc-4954-8967-7e17e5b19868 req-133307c0-08bb-40cd-85c0-b73ebf5c5576 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:03.238969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-6d73f2bf-b8bc-4954-8967-7e17e5b19868 req-133307c0-08bb-40cd-85c0-b73ebf5c5576 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:03.249747 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-6d73f2bf-b8bc-4954-8967-7e17e5b19868 req-133307c0-08bb-40cd-85c0-b73ebf5c5576 service nova] Creating event network-changed:0a916c19-f60f-4185-8d5c-62020d7bdb15 for instance eca2fa96-252e-4d26-87eb-74cee3ee6c7d on hv-cinder-84112 May 23 15:41:03.254897 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-6d73f2bf-b8bc-4954-8967-7e17e5b19868 req-133307c0-08bb-40cd-85c0-b73ebf5c5576 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086851 May 23 15:41:03.255705 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 534/1053] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:03.408676 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-93a7e907-56f2-4dec-9b79-f1d72a8b0db0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:03.409431 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-93a7e907-56f2-4dec-9b79-f1d72a8b0db0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:03.421198 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-93a7e907-56f2-4dec-9b79-f1d72a8b0db0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:03.423410 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-93a7e907-56f2-4dec-9b79-f1d72a8b0db0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:03.424604 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-93a7e907-56f2-4dec-9b79-f1d72a8b0db0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:03.425249 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-93a7e907-56f2-4dec-9b79-f1d72a8b0db0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:03.534247 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-93a7e907-56f2-4dec-9b79-f1d72a8b0db0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:03.545083 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-93a7e907-56f2-4dec-9b79-f1d72a8b0db0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1205 microversion: 2.1 time: 0.139290 May 23 15:41:03.546508 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 520/1054] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:41:03 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1205 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:04.564044 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f8ca9a5d-9610-4945-a309-14e45a109c65 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:04.564659 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f8ca9a5d-9610-4945-a309-14e45a109c65 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:04.571004 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f8ca9a5d-9610-4945-a309-14e45a109c65 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:04.571455 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f8ca9a5d-9610-4945-a309-14e45a109c65 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:04.572221 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f8ca9a5d-9610-4945-a309-14e45a109c65 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:04.572658 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f8ca9a5d-9610-4945-a309-14e45a109c65 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:04.795552 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-f8ca9a5d-9610-4945-a309-14e45a109c65 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:04.803577 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f8ca9a5d-9610-4945-a309-14e45a109c65 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1260 microversion: 2.1 time: 0.244197 May 23 15:41:04.810637 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 535/1055] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:41:04 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:05.273783 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-eaa0ba6e-cf15-4e49-a70c-4a31cf6c60b8 req-93e57e7b-3b3d-4bfe-899b-9c19b44499be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dff4ee13-17c0-4b09-abc7-488e123e6899", "tag": "300409dc-55b8-410d-b8c1-b461d6270c87"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:41:05.281867 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-eaa0ba6e-cf15-4e49-a70c-4a31cf6c60b8 req-93e57e7b-3b3d-4bfe-899b-9c19b44499be service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:05.282313 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-eaa0ba6e-cf15-4e49-a70c-4a31cf6c60b8 req-93e57e7b-3b3d-4bfe-899b-9c19b44499be service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:05.293602 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-eaa0ba6e-cf15-4e49-a70c-4a31cf6c60b8 req-93e57e7b-3b3d-4bfe-899b-9c19b44499be service nova] Creating event network-changed:300409dc-55b8-410d-b8c1-b461d6270c87 for instance dff4ee13-17c0-4b09-abc7-488e123e6899 on hv-cinder-84112 May 23 15:41:05.299347 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-eaa0ba6e-cf15-4e49-a70c-4a31cf6c60b8 req-93e57e7b-3b3d-4bfe-899b-9c19b44499be service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030222 May 23 15:41:05.299900 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 521/1056] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:05.827556 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-76e5dd8e-e399-41eb-ba18-cba451d6a43f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:05.828176 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-76e5dd8e-e399-41eb-ba18-cba451d6a43f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:05.834714 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-76e5dd8e-e399-41eb-ba18-cba451d6a43f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:05.835164 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-76e5dd8e-e399-41eb-ba18-cba451d6a43f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:05.835933 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-76e5dd8e-e399-41eb-ba18-cba451d6a43f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:05.836369 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-76e5dd8e-e399-41eb-ba18-cba451d6a43f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:06.041827 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-76e5dd8e-e399-41eb-ba18-cba451d6a43f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:06.050084 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-76e5dd8e-e399-41eb-ba18-cba451d6a43f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1260 microversion: 2.1 time: 0.226976 May 23 15:41:06.050665 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 536/1057] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:41:05 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:07.068197 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-0f498056-85f4-4a61-9a94-db63b74687d6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:07.068970 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-0f498056-85f4-4a61-9a94-db63b74687d6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:07.075218 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0f498056-85f4-4a61-9a94-db63b74687d6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:07.076286 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0f498056-85f4-4a61-9a94-db63b74687d6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:07.077127 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0f498056-85f4-4a61-9a94-db63b74687d6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:07.077595 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-0f498056-85f4-4a61-9a94-db63b74687d6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:07.209169 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-0f498056-85f4-4a61-9a94-db63b74687d6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:07.216723 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-0f498056-85f4-4a61-9a94-db63b74687d6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1260 microversion: 2.1 time: 0.153432 May 23 15:41:07.217324 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 522/1058] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:41:07 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:08.233880 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-944eb497-f3a8-4250-92cf-72e6afc50b97 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:08.234518 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-944eb497-f3a8-4250-92cf-72e6afc50b97 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:08.241058 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-944eb497-f3a8-4250-92cf-72e6afc50b97 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:08.241515 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-944eb497-f3a8-4250-92cf-72e6afc50b97 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:08.242291 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-944eb497-f3a8-4250-92cf-72e6afc50b97 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:08.242731 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-944eb497-f3a8-4250-92cf-72e6afc50b97 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:08.375527 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-944eb497-f3a8-4250-92cf-72e6afc50b97 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:08.382980 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-944eb497-f3a8-4250-92cf-72e6afc50b97 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1260 microversion: 2.1 time: 0.153234 May 23 15:41:08.383545 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 537/1059] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:41:08 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:09.399619 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c08be642-282e-4bb9-8449-591623e53015 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:09.400162 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c08be642-282e-4bb9-8449-591623e53015 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:09.407366 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c08be642-282e-4bb9-8449-591623e53015 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:09.407822 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c08be642-282e-4bb9-8449-591623e53015 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:09.408601 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c08be642-282e-4bb9-8449-591623e53015 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:09.409083 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c08be642-282e-4bb9-8449-591623e53015 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:09.538484 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c08be642-282e-4bb9-8449-591623e53015 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:09.546506 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c08be642-282e-4bb9-8449-591623e53015 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1260 microversion: 2.1 time: 0.150855 May 23 15:41:09.547277 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 523/1060] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:41:09 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:10.563988 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-7d483186-17fb-402f-b83b-6bc830f90eef tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:10.565620 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-7d483186-17fb-402f-b83b-6bc830f90eef tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:10.571107 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7d483186-17fb-402f-b83b-6bc830f90eef tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:10.571550 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7d483186-17fb-402f-b83b-6bc830f90eef tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:10.572309 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7d483186-17fb-402f-b83b-6bc830f90eef tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:10.572749 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-7d483186-17fb-402f-b83b-6bc830f90eef tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:10.707688 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-7d483186-17fb-402f-b83b-6bc830f90eef tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:10.715183 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-7d483186-17fb-402f-b83b-6bc830f90eef tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1260 microversion: 2.1 time: 0.155874 May 23 15:41:10.715752 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 538/1061] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:41:10 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:11.732482 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-313570cc-ce6d-43ba-9655-36bbeb0b436c tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:11.733135 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-313570cc-ce6d-43ba-9655-36bbeb0b436c tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:11.739907 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-313570cc-ce6d-43ba-9655-36bbeb0b436c tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:11.740367 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-313570cc-ce6d-43ba-9655-36bbeb0b436c tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:11.741162 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-313570cc-ce6d-43ba-9655-36bbeb0b436c tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:11.741611 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-313570cc-ce6d-43ba-9655-36bbeb0b436c tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:11.871834 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-313570cc-ce6d-43ba-9655-36bbeb0b436c tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:11.880005 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-313570cc-ce6d-43ba-9655-36bbeb0b436c tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1260 microversion: 2.1 time: 0.151509 May 23 15:41:11.880576 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 524/1062] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:41:11 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:12.897260 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-62fa6cb7-d63b-43da-9570-dd0b1f654e1a tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:12.897877 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-62fa6cb7-d63b-43da-9570-dd0b1f654e1a tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:12.900302 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=2 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:12.901054 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=6 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:12.907433 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-62fa6cb7-d63b-43da-9570-dd0b1f654e1a tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:12.907879 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-62fa6cb7-d63b-43da-9570-dd0b1f654e1a tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:12.908648 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-62fa6cb7-d63b-43da-9570-dd0b1f654e1a tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:12.909113 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-62fa6cb7-d63b-43da-9570-dd0b1f654e1a tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:13.045447 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-62fa6cb7-d63b-43da-9570-dd0b1f654e1a tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:13.052910 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-62fa6cb7-d63b-43da-9570-dd0b1f654e1a tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1260 microversion: 2.1 time: 0.159582 May 23 15:41:13.053487 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 539/1063] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:41:12 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:14.069751 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-62c84fd1-7a12-46b5-a53b-15a8b5cc57ed tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:14.070406 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-62c84fd1-7a12-46b5-a53b-15a8b5cc57ed tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:14.072373 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:14.079158 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-62c84fd1-7a12-46b5-a53b-15a8b5cc57ed tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:14.079620 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-62c84fd1-7a12-46b5-a53b-15a8b5cc57ed tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:14.080403 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-62c84fd1-7a12-46b5-a53b-15a8b5cc57ed tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:14.080852 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-62c84fd1-7a12-46b5-a53b-15a8b5cc57ed tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:14.211108 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-62c84fd1-7a12-46b5-a53b-15a8b5cc57ed tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:14.219839 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-62c84fd1-7a12-46b5-a53b-15a8b5cc57ed tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1260 microversion: 2.1 time: 0.153960 May 23 15:41:14.220414 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 525/1064] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:41:14 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:14.754624 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-1949ed64-ca7c-44c3-97ee-b7ec771c621d req-25c80f00-9086-4291-bb81-791f63fdf45b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff4ee13-17c0-4b09-abc7-488e123e6899", "name": "network-vif-plugged", "status": "completed", "tag": "300409dc-55b8-410d-b8c1-b461d6270c87"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:41:14.758513 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:14.765745 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-1949ed64-ca7c-44c3-97ee-b7ec771c621d req-25c80f00-9086-4291-bb81-791f63fdf45b service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:14.766205 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-1949ed64-ca7c-44c3-97ee-b7ec771c621d req-25c80f00-9086-4291-bb81-791f63fdf45b service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:14.770492 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=85 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:14.779206 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-1949ed64-ca7c-44c3-97ee-b7ec771c621d req-25c80f00-9086-4291-bb81-791f63fdf45b service nova] Creating event network-vif-plugged:300409dc-55b8-410d-b8c1-b461d6270c87 for instance dff4ee13-17c0-4b09-abc7-488e123e6899 on hv-cinder-84112 May 23 15:41:14.784252 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-1949ed64-ca7c-44c3-97ee-b7ec771c621d req-25c80f00-9086-4291-bb81-791f63fdf45b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033411 May 23 15:41:14.784852 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 540/1065] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:15.237341 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-3941c303-0fe6-4603-874b-b36509881e90 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:15.237885 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-3941c303-0fe6-4603-874b-b36509881e90 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:15.240199 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:15.245511 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3941c303-0fe6-4603-874b-b36509881e90 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:15.245963 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3941c303-0fe6-4603-874b-b36509881e90 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:15.246733 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3941c303-0fe6-4603-874b-b36509881e90 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:15.247176 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-3941c303-0fe6-4603-874b-b36509881e90 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:15.250670 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:15.382388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-3941c303-0fe6-4603-874b-b36509881e90 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:15.389866 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-3941c303-0fe6-4603-874b-b36509881e90 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1260 microversion: 2.1 time: 0.157128 May 23 15:41:15.390431 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 526/1066] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:41:15 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:16.407960 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-9ad44cb4-d296-4405-afd4-5b1c62e6cbe0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:16.408668 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-9ad44cb4-d296-4405-afd4-5b1c62e6cbe0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:16.414930 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9ad44cb4-d296-4405-afd4-5b1c62e6cbe0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:16.415387 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9ad44cb4-d296-4405-afd4-5b1c62e6cbe0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:16.416413 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9ad44cb4-d296-4405-afd4-5b1c62e6cbe0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:16.416853 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9ad44cb4-d296-4405-afd4-5b1c62e6cbe0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:16.549595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9ad44cb4-d296-4405-afd4-5b1c62e6cbe0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:16.557083 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-9ad44cb4-d296-4405-afd4-5b1c62e6cbe0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1443 microversion: 2.1 time: 0.154027 May 23 15:41:16.557650 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 541/1067] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:41:16 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:16.574536 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1026c4f0-1294-451d-a7bb-b0d5262d5def tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:16.575161 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-1026c4f0-1294-451d-a7bb-b0d5262d5def tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:16.582399 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1026c4f0-1294-451d-a7bb-b0d5262d5def tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:16.582968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1026c4f0-1294-451d-a7bb-b0d5262d5def tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:16.583811 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1026c4f0-1294-451d-a7bb-b0d5262d5def tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:16.584319 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-1026c4f0-1294-451d-a7bb-b0d5262d5def tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:16.715134 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-1026c4f0-1294-451d-a7bb-b0d5262d5def tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:16.723271 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1026c4f0-1294-451d-a7bb-b0d5262d5def tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1443 microversion: 2.1 time: 0.152574 May 23 15:41:16.724038 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 527/1068] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:41:16 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:18.400440 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-2ee3ba97-f2ef-4bd0-bbea-514c5a7fc732 req-f51a7d78-dff2-416f-b639-b69100feb3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dff4ee13-17c0-4b09-abc7-488e123e6899", "tag": "300409dc-55b8-410d-b8c1-b461d6270c87"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:41:18.409987 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-2ee3ba97-f2ef-4bd0-bbea-514c5a7fc732 req-f51a7d78-dff2-416f-b639-b69100feb3f4 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:18.410524 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-2ee3ba97-f2ef-4bd0-bbea-514c5a7fc732 req-f51a7d78-dff2-416f-b639-b69100feb3f4 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:18.422456 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-2ee3ba97-f2ef-4bd0-bbea-514c5a7fc732 req-f51a7d78-dff2-416f-b639-b69100feb3f4 service nova] Creating event network-changed:300409dc-55b8-410d-b8c1-b461d6270c87 for instance dff4ee13-17c0-4b09-abc7-488e123e6899 on hv-cinder-84112 May 23 15:41:18.427379 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-2ee3ba97-f2ef-4bd0-bbea-514c5a7fc732 req-f51a7d78-dff2-416f-b639-b69100feb3f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031473 May 23 15:41:18.428270 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 542/1069] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:47.239291 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:41:47.239861 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Mon May 23 15:41:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:42:41.334933 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=3 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:41.335678 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=11 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:41.340151 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ae82ab19-0668-4e3d-988b-0c8729cd84fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1628505318", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1729280906", "security_groups": [{"name": "tempest-secgroup-smoke-1491515110"}], "block_device_mapping_v2": [{"uuid": "288edcbb-2667-4e86-8a7f-e2f8e25c1a69", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ca014fd-aa0f-4216-ae7a-a155fcb74406"}]}} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:42:41.450684 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.network.neutron [None req-ae82ab19-0668-4e3d-988b-0c8729cd84fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] validate_networks() for [('5ca014fd-aa0f-4216-ae7a-a155fcb74406', None, None, None, None, None)] {{(pid=117973) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:42:41.909792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-ae82ab19-0668-4e3d-988b-0c8729cd84fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Flavor limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:42:41.910218 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-ae82ab19-0668-4e3d-988b-0c8729cd84fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Image limits 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:42:41.910727 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-ae82ab19-0668-4e3d-988b-0c8729cd84fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Flavor pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:42:41.911141 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-ae82ab19-0668-4e3d-988b-0c8729cd84fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Image pref 0:0:0 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:42:41.911559 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.virt.hardware [None req-ae82ab19-0668-4e3d-988b-0c8729cd84fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:42:41.920222 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ae82ab19-0668-4e3d-988b-0c8729cd84fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:41.920672 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ae82ab19-0668-4e3d-988b-0c8729cd84fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:41.921526 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ae82ab19-0668-4e3d-988b-0c8729cd84fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:41.922215 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ae82ab19-0668-4e3d-988b-0c8729cd84fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:41.939113 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-ae82ab19-0668-4e3d-988b-0c8729cd84fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Getting quotas for project 449514f02fbc485484110bde5a2018c0. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:42:41.943786 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.quota [None req-ae82ab19-0668-4e3d-988b-0c8729cd84fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Getting quotas for user 01d7c2fa381541139ea7aebaf2ae688f and project 449514f02fbc485484110bde5a2018c0. Resources: {'instances', 'ram', 'cores'} {{(pid=117973) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:42:42.005486 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ae82ab19-0668-4e3d-988b-0c8729cd84fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Going to run 1 instances... {{(pid=117973) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:42:42.007576 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ae82ab19-0668-4e3d-988b-0c8729cd84fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='288edcbb-2667-4e86-8a7f-e2f8e25c1a69',volume_size=None,volume_type=None)] {{(pid=117973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:42:42.145020 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ae82ab19-0668-4e3d-988b-0c8729cd84fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.811799 May 23 15:42:42.145663 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 528/1070] 10.222.0.30 () {60 vars in 1146 bytes} [Mon May 23 15:42:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:42:42.154238 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=5 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:42.155609 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=9 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:42.160720 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-d5c7e241-f85c-445c-95b6-058790a899e0 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:42.161448 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-d5c7e241-f85c-445c-95b6-058790a899e0 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:42.216485 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-d5c7e241-f85c-445c-95b6-058790a899e0 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:42.223953 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-d5c7e241-f85c-445c-95b6-058790a899e0 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1095 microversion: 2.1 time: 0.071929 May 23 15:42:42.224524 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 543/1071] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:42:42 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:43.242384 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-cad19d6a-b07f-4c06-a002-e9f99926c2ed tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:43.243745 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-cad19d6a-b07f-4c06-a002-e9f99926c2ed tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:43.250196 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cad19d6a-b07f-4c06-a002-e9f99926c2ed tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:43.250656 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cad19d6a-b07f-4c06-a002-e9f99926c2ed tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:43.251440 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cad19d6a-b07f-4c06-a002-e9f99926c2ed tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:43.251886 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cad19d6a-b07f-4c06-a002-e9f99926c2ed tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:43.317594 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-cad19d6a-b07f-4c06-a002-e9f99926c2ed tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:43.325130 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-cad19d6a-b07f-4c06-a002-e9f99926c2ed tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1201 microversion: 2.1 time: 0.087913 May 23 15:42:43.325689 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 529/1072] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:42:43 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1201 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:44.342556 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-e4e77bf7-528d-417a-8308-e628f969348b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:44.343179 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-e4e77bf7-528d-417a-8308-e628f969348b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:44.351876 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e4e77bf7-528d-417a-8308-e628f969348b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:44.352334 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e4e77bf7-528d-417a-8308-e628f969348b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:44.353145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e4e77bf7-528d-417a-8308-e628f969348b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:44.353594 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-e4e77bf7-528d-417a-8308-e628f969348b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:44.602198 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-e4e77bf7-528d-417a-8308-e628f969348b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:44.611937 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-e4e77bf7-528d-417a-8308-e628f969348b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1267 microversion: 2.1 time: 0.273469 May 23 15:42:44.613234 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 544/1073] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:42:44 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1267 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:44.979553 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-00f2d122-c4b1-466e-a991-bfb01cf3dc59 req-28a721bc-2704-484e-b77c-db951bc4661a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b9f2c7-9802-4ba9-9cca-a5725bae68e6", "tag": "0a474cc8-872c-46fc-ad61-6c4536ac5bac"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:42:44.988818 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-00f2d122-c4b1-466e-a991-bfb01cf3dc59 req-28a721bc-2704-484e-b77c-db951bc4661a service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:44.989404 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-00f2d122-c4b1-466e-a991-bfb01cf3dc59 req-28a721bc-2704-484e-b77c-db951bc4661a service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:45.007229 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-00f2d122-c4b1-466e-a991-bfb01cf3dc59 req-28a721bc-2704-484e-b77c-db951bc4661a service nova] Creating event network-changed:0a474cc8-872c-46fc-ad61-6c4536ac5bac for instance 83b9f2c7-9802-4ba9-9cca-a5725bae68e6 on hv-cinder-84112 May 23 15:42:45.012309 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-00f2d122-c4b1-466e-a991-bfb01cf3dc59 req-28a721bc-2704-484e-b77c-db951bc4661a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036718 May 23 15:42:45.013350 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 530/1074] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:42:45.629612 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-fa4f7740-d59b-4da9-9aa0-3d0671a9cb4a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:45.630268 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-fa4f7740-d59b-4da9-9aa0-3d0671a9cb4a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:45.636806 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fa4f7740-d59b-4da9-9aa0-3d0671a9cb4a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:45.637292 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fa4f7740-d59b-4da9-9aa0-3d0671a9cb4a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:45.638066 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fa4f7740-d59b-4da9-9aa0-3d0671a9cb4a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:45.638507 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-fa4f7740-d59b-4da9-9aa0-3d0671a9cb4a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:45.773738 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-fa4f7740-d59b-4da9-9aa0-3d0671a9cb4a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:45.781249 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-fa4f7740-d59b-4da9-9aa0-3d0671a9cb4a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1267 microversion: 2.1 time: 0.155520 May 23 15:42:45.781814 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 545/1075] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:42:45 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:46.799978 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-805efe2d-61cc-467e-9651-bc61d98ca567 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:46.801370 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-805efe2d-61cc-467e-9651-bc61d98ca567 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:46.807600 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-805efe2d-61cc-467e-9651-bc61d98ca567 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:46.808047 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-805efe2d-61cc-467e-9651-bc61d98ca567 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:46.808813 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-805efe2d-61cc-467e-9651-bc61d98ca567 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:46.809278 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-805efe2d-61cc-467e-9651-bc61d98ca567 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:46.947183 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-805efe2d-61cc-467e-9651-bc61d98ca567 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:46.954670 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-805efe2d-61cc-467e-9651-bc61d98ca567 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1267 microversion: 2.1 time: 0.159711 May 23 15:42:46.955235 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 531/1076] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:42:46 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:47.971542 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-5ff58d90-11d9-4b03-85ab-3e2ee6f1e027 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:47.972087 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-5ff58d90-11d9-4b03-85ab-3e2ee6f1e027 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:47.978546 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5ff58d90-11d9-4b03-85ab-3e2ee6f1e027 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:47.978998 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5ff58d90-11d9-4b03-85ab-3e2ee6f1e027 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:47.979762 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5ff58d90-11d9-4b03-85ab-3e2ee6f1e027 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:47.980199 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-5ff58d90-11d9-4b03-85ab-3e2ee6f1e027 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:48.111328 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-5ff58d90-11d9-4b03-85ab-3e2ee6f1e027 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:48.119331 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-5ff58d90-11d9-4b03-85ab-3e2ee6f1e027 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1267 microversion: 2.1 time: 0.151726 May 23 15:42:48.119932 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 546/1077] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:42:47 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:49.135917 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-4bddb2b1-2678-48b9-b28e-52fcb078fe3e tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:49.136548 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-4bddb2b1-2678-48b9-b28e-52fcb078fe3e tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:49.143074 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4bddb2b1-2678-48b9-b28e-52fcb078fe3e tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:49.143533 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4bddb2b1-2678-48b9-b28e-52fcb078fe3e tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:49.144309 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4bddb2b1-2678-48b9-b28e-52fcb078fe3e tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:49.144756 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4bddb2b1-2678-48b9-b28e-52fcb078fe3e tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:49.272779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-4bddb2b1-2678-48b9-b28e-52fcb078fe3e tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:49.280432 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-4bddb2b1-2678-48b9-b28e-52fcb078fe3e tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1267 microversion: 2.1 time: 0.148402 May 23 15:42:49.281040 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 532/1078] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:42:49 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:50.297856 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-70c6bc2e-7701-4817-8144-1d4255c51bb1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:50.298446 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-70c6bc2e-7701-4817-8144-1d4255c51bb1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:50.305712 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-70c6bc2e-7701-4817-8144-1d4255c51bb1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:50.306158 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-70c6bc2e-7701-4817-8144-1d4255c51bb1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:50.306918 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-70c6bc2e-7701-4817-8144-1d4255c51bb1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:50.307351 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-70c6bc2e-7701-4817-8144-1d4255c51bb1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:50.451015 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-70c6bc2e-7701-4817-8144-1d4255c51bb1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:50.458474 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-70c6bc2e-7701-4817-8144-1d4255c51bb1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1267 microversion: 2.1 time: 0.164715 May 23 15:42:50.459301 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 547/1079] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:42:50 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:51.475477 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ccac1532-ac92-4dd0-af6d-5ea8e20ab6d2 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:51.476100 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ccac1532-ac92-4dd0-af6d-5ea8e20ab6d2 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:51.483001 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ccac1532-ac92-4dd0-af6d-5ea8e20ab6d2 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:51.483451 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ccac1532-ac92-4dd0-af6d-5ea8e20ab6d2 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:51.484223 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ccac1532-ac92-4dd0-af6d-5ea8e20ab6d2 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:51.484661 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ccac1532-ac92-4dd0-af6d-5ea8e20ab6d2 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:51.613321 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ccac1532-ac92-4dd0-af6d-5ea8e20ab6d2 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:51.621687 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ccac1532-ac92-4dd0-af6d-5ea8e20ab6d2 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1267 microversion: 2.1 time: 0.149708 May 23 15:42:51.622076 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 533/1080] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:42:51 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:52.638004 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-56229747-0671-44ea-b7a1-f9fbb530efca tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:52.638616 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-56229747-0671-44ea-b7a1-f9fbb530efca tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:52.640974 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell0:SELECT=2 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:52.646225 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-56229747-0671-44ea-b7a1-f9fbb530efca tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:52.647281 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-56229747-0671-44ea-b7a1-f9fbb530efca tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:52.648232 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-56229747-0671-44ea-b7a1-f9fbb530efca tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:52.648517 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-56229747-0671-44ea-b7a1-f9fbb530efca tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:52.779546 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-56229747-0671-44ea-b7a1-f9fbb530efca tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:52.787090 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-56229747-0671-44ea-b7a1-f9fbb530efca tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1267 microversion: 2.1 time: 0.152940 May 23 15:42:52.787665 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 548/1081] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:42:52 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:53.803834 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-bfab7216-2682-4b95-8448-e7bb56a8345c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:53.804475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-bfab7216-2682-4b95-8448-e7bb56a8345c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:53.806655 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:53.807339 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell0:SELECT=6 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:53.813845 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bfab7216-2682-4b95-8448-e7bb56a8345c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:53.814293 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bfab7216-2682-4b95-8448-e7bb56a8345c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:53.815097 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bfab7216-2682-4b95-8448-e7bb56a8345c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:53.815534 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-bfab7216-2682-4b95-8448-e7bb56a8345c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:53.956576 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-bfab7216-2682-4b95-8448-e7bb56a8345c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:53.964357 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-bfab7216-2682-4b95-8448-e7bb56a8345c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1267 microversion: 2.1 time: 0.164424 May 23 15:42:53.964949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 534/1082] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:42:53 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:54.981432 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-30f44fdc-d5bd-4b22-9afa-ae6967ff4d97 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:54.981958 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-30f44fdc-d5bd-4b22-9afa-ae6967ff4d97 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:54.988396 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-30f44fdc-d5bd-4b22-9afa-ae6967ff4d97 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:54.988844 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-30f44fdc-d5bd-4b22-9afa-ae6967ff4d97 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:54.989645 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-30f44fdc-d5bd-4b22-9afa-ae6967ff4d97 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:54.990086 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-30f44fdc-d5bd-4b22-9afa-ae6967ff4d97 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:55.123372 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-30f44fdc-d5bd-4b22-9afa-ae6967ff4d97 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:55.131454 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-30f44fdc-d5bd-4b22-9afa-ae6967ff4d97 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1267 microversion: 2.1 time: 0.153483 May 23 15:42:55.132020 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 549/1083] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:42:54 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:55.260881 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-b9d78792-accd-435c-8c20-b7cc4536092b req-9240b09b-6f6c-4ca0-abad-dc70546245fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b9f2c7-9802-4ba9-9cca-a5725bae68e6", "name": "network-vif-plugged", "status": "completed", "tag": "0a474cc8-872c-46fc-ad61-6c4536ac5bac"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:42:55.270046 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-b9d78792-accd-435c-8c20-b7cc4536092b req-9240b09b-6f6c-4ca0-abad-dc70546245fb service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:55.270782 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-b9d78792-accd-435c-8c20-b7cc4536092b req-9240b09b-6f6c-4ca0-abad-dc70546245fb service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:55.283057 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-b9d78792-accd-435c-8c20-b7cc4536092b req-9240b09b-6f6c-4ca0-abad-dc70546245fb service nova] Creating event network-vif-plugged:0a474cc8-872c-46fc-ad61-6c4536ac5bac for instance 83b9f2c7-9802-4ba9-9cca-a5725bae68e6 on hv-cinder-84112 May 23 15:42:55.288211 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-b9d78792-accd-435c-8c20-b7cc4536092b req-9240b09b-6f6c-4ca0-abad-dc70546245fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031950 May 23 15:42:55.288800 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 535/1084] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:42:56.148024 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-6089d4b3-1285-4e7f-b676-8453863c3434 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:56.148663 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-6089d4b3-1285-4e7f-b676-8453863c3434 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:56.155197 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6089d4b3-1285-4e7f-b676-8453863c3434 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:56.155654 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6089d4b3-1285-4e7f-b676-8453863c3434 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:56.156446 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6089d4b3-1285-4e7f-b676-8453863c3434 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:56.156905 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6089d4b3-1285-4e7f-b676-8453863c3434 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:56.288376 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-6089d4b3-1285-4e7f-b676-8453863c3434 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:56.295902 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-6089d4b3-1285-4e7f-b676-8453863c3434 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1267 microversion: 2.1 time: 0.152314 May 23 15:42:56.296460 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 550/1085] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:42:56 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:57.313253 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-4dc1b0ff-e086-4788-85f1-00778c2e6a55 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:57.313961 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-4dc1b0ff-e086-4788-85f1-00778c2e6a55 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:57.320699 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4dc1b0ff-e086-4788-85f1-00778c2e6a55 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:57.321180 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4dc1b0ff-e086-4788-85f1-00778c2e6a55 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:57.321954 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4dc1b0ff-e086-4788-85f1-00778c2e6a55 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:57.322396 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4dc1b0ff-e086-4788-85f1-00778c2e6a55 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:57.453128 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-4dc1b0ff-e086-4788-85f1-00778c2e6a55 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:57.461197 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-4dc1b0ff-e086-4788-85f1-00778c2e6a55 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1453 microversion: 2.1 time: 0.152263 May 23 15:42:57.461761 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 536/1086] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:42:57 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:57.478892 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-bcd741ad-d6dd-4542-9379-0cc163ade34a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:57.479512 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-bcd741ad-d6dd-4542-9379-0cc163ade34a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:57.485919 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bcd741ad-d6dd-4542-9379-0cc163ade34a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:57.486413 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bcd741ad-d6dd-4542-9379-0cc163ade34a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:57.487187 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bcd741ad-d6dd-4542-9379-0cc163ade34a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:57.487625 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-bcd741ad-d6dd-4542-9379-0cc163ade34a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:57.625336 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-bcd741ad-d6dd-4542-9379-0cc163ade34a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:57.633156 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-bcd741ad-d6dd-4542-9379-0cc163ade34a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1453 microversion: 2.1 time: 0.158687 May 23 15:42:57.633729 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 551/1087] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:42:57 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:59.857949 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-da85651e-ccc2-49d2-ab86-465c23289c5d req-9e674b77-473d-4c3e-8cd5-a8a335833db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b9f2c7-9802-4ba9-9cca-a5725bae68e6", "tag": "0a474cc8-872c-46fc-ad61-6c4536ac5bac"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:42:59.867236 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-da85651e-ccc2-49d2-ab86-465c23289c5d req-9e674b77-473d-4c3e-8cd5-a8a335833db1 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:59.867771 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-da85651e-ccc2-49d2-ab86-465c23289c5d req-9e674b77-473d-4c3e-8cd5-a8a335833db1 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:59.879129 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-da85651e-ccc2-49d2-ab86-465c23289c5d req-9e674b77-473d-4c3e-8cd5-a8a335833db1 service nova] Creating event network-changed:0a474cc8-872c-46fc-ad61-6c4536ac5bac for instance 83b9f2c7-9802-4ba9-9cca-a5725bae68e6 on hv-cinder-84112 May 23 15:42:59.885425 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-da85651e-ccc2-49d2-ab86-465c23289c5d req-9e674b77-473d-4c3e-8cd5-a8a335833db1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031237 May 23 15:42:59.886152 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 537/1088] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:43:15.981430 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-748b4265-4b1f-471e-84b5-f57a1d2a12f6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:15.981963 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-748b4265-4b1f-471e-84b5-f57a1d2a12f6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:15.983910 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=20 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:15.984698 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=48 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:15.991005 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-748b4265-4b1f-471e-84b5-f57a1d2a12f6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:15.991459 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-748b4265-4b1f-471e-84b5-f57a1d2a12f6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:15.992231 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-748b4265-4b1f-471e-84b5-f57a1d2a12f6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:15.992839 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-748b4265-4b1f-471e-84b5-f57a1d2a12f6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:16.015615 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.objects.instance [None req-748b4265-4b1f-471e-84b5-f57a1d2a12f6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lazy-loading 'flavor' on Instance uuid dff4ee13-17c0-4b09-abc7-488e123e6899 {{(pid=117974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:43:16.085826 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-748b4265-4b1f-471e-84b5-f57a1d2a12f6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "POST /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899/action" status: 202 len: 0 microversion: 2.1 time: 0.108571 May 23 15:43:16.087134 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 552/1089] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 15:43:15 2022] POST /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:43:16.093371 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:16.094123 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=44 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:16.098549 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-94939d9c-7464-458f-8b85-2826bdf97ff3 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:16.099266 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-94939d9c-7464-458f-8b85-2826bdf97ff3 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:16.106830 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-94939d9c-7464-458f-8b85-2826bdf97ff3 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:16.107290 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-94939d9c-7464-458f-8b85-2826bdf97ff3 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:16.108036 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-94939d9c-7464-458f-8b85-2826bdf97ff3 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:16.108471 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-94939d9c-7464-458f-8b85-2826bdf97ff3 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:16.241911 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-94939d9c-7464-458f-8b85-2826bdf97ff3 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:16.250198 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-94939d9c-7464-458f-8b85-2826bdf97ff3 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1568 microversion: 2.1 time: 0.158365 May 23 15:43:16.250758 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 538/1090] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:16 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:17.268329 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-8decac0e-982e-492f-9711-c0e7a041da82 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:17.269051 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-8decac0e-982e-492f-9711-c0e7a041da82 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:17.275807 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8decac0e-982e-492f-9711-c0e7a041da82 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:17.276255 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8decac0e-982e-492f-9711-c0e7a041da82 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:17.277040 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8decac0e-982e-492f-9711-c0e7a041da82 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:17.277474 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-8decac0e-982e-492f-9711-c0e7a041da82 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:17.410112 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-8decac0e-982e-492f-9711-c0e7a041da82 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:17.417569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-8decac0e-982e-492f-9711-c0e7a041da82 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1568 microversion: 2.1 time: 0.154011 May 23 15:43:17.418135 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 553/1091] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:17 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:18.434653 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-166b3423-1824-4a9b-bd06-f575e7ee1103 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:18.435276 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-166b3423-1824-4a9b-bd06-f575e7ee1103 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:18.441842 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-166b3423-1824-4a9b-bd06-f575e7ee1103 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:18.442309 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-166b3423-1824-4a9b-bd06-f575e7ee1103 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:18.443072 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-166b3423-1824-4a9b-bd06-f575e7ee1103 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:18.443520 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-166b3423-1824-4a9b-bd06-f575e7ee1103 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:18.577878 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-166b3423-1824-4a9b-bd06-f575e7ee1103 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:18.585451 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-166b3423-1824-4a9b-bd06-f575e7ee1103 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1568 microversion: 2.1 time: 0.154682 May 23 15:43:18.586030 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 539/1092] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:18 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:19.603500 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-317cf9bd-6569-4b39-9b00-0fb7b7f0196b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:19.604128 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-317cf9bd-6569-4b39-9b00-0fb7b7f0196b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:19.610680 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-317cf9bd-6569-4b39-9b00-0fb7b7f0196b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:19.611133 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-317cf9bd-6569-4b39-9b00-0fb7b7f0196b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:19.611915 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-317cf9bd-6569-4b39-9b00-0fb7b7f0196b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:19.612356 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-317cf9bd-6569-4b39-9b00-0fb7b7f0196b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:19.744595 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-317cf9bd-6569-4b39-9b00-0fb7b7f0196b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:19.752127 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-317cf9bd-6569-4b39-9b00-0fb7b7f0196b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1568 microversion: 2.1 time: 0.153254 May 23 15:43:19.752699 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 554/1093] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:19 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:20.769104 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-298e7ab9-7df3-491b-83d9-cf7d5f008a6f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:20.769725 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-298e7ab9-7df3-491b-83d9-cf7d5f008a6f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:20.776211 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-298e7ab9-7df3-491b-83d9-cf7d5f008a6f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:20.776662 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-298e7ab9-7df3-491b-83d9-cf7d5f008a6f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:20.777462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-298e7ab9-7df3-491b-83d9-cf7d5f008a6f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:20.777910 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-298e7ab9-7df3-491b-83d9-cf7d5f008a6f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:20.911499 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-298e7ab9-7df3-491b-83d9-cf7d5f008a6f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:20.919046 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-298e7ab9-7df3-491b-83d9-cf7d5f008a6f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1568 microversion: 2.1 time: 0.153845 May 23 15:43:20.919618 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 540/1094] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:20 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:21.936413 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-b5597bf7-ddb9-4436-93c4-7dab91d8afa3 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:21.936983 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-b5597bf7-ddb9-4436-93c4-7dab91d8afa3 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:21.943644 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b5597bf7-ddb9-4436-93c4-7dab91d8afa3 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:21.944098 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b5597bf7-ddb9-4436-93c4-7dab91d8afa3 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:21.944881 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b5597bf7-ddb9-4436-93c4-7dab91d8afa3 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:21.945326 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-b5597bf7-ddb9-4436-93c4-7dab91d8afa3 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:22.074236 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-b5597bf7-ddb9-4436-93c4-7dab91d8afa3 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:22.081869 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-b5597bf7-ddb9-4436-93c4-7dab91d8afa3 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1568 microversion: 2.1 time: 0.149410 May 23 15:43:22.082444 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 555/1095] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:21 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:23.099682 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7f09c3d2-fa3b-4d5e-bccf-0a1410ab87ed tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:23.100305 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7f09c3d2-fa3b-4d5e-bccf-0a1410ab87ed tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:23.107462 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7f09c3d2-fa3b-4d5e-bccf-0a1410ab87ed tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:23.107917 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7f09c3d2-fa3b-4d5e-bccf-0a1410ab87ed tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:23.108688 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7f09c3d2-fa3b-4d5e-bccf-0a1410ab87ed tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:23.109163 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7f09c3d2-fa3b-4d5e-bccf-0a1410ab87ed tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:23.239546 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-7f09c3d2-fa3b-4d5e-bccf-0a1410ab87ed tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:23.247061 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7f09c3d2-fa3b-4d5e-bccf-0a1410ab87ed tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1568 microversion: 2.1 time: 0.151289 May 23 15:43:23.247629 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 541/1096] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:23 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:24.264262 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-580dc155-0c75-4e6b-89f6-53df99f01af0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:24.264891 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-580dc155-0c75-4e6b-89f6-53df99f01af0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:24.271466 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-580dc155-0c75-4e6b-89f6-53df99f01af0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:24.271916 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-580dc155-0c75-4e6b-89f6-53df99f01af0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:24.272682 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-580dc155-0c75-4e6b-89f6-53df99f01af0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:24.273145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-580dc155-0c75-4e6b-89f6-53df99f01af0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:24.405255 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-580dc155-0c75-4e6b-89f6-53df99f01af0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:24.412752 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-580dc155-0c75-4e6b-89f6-53df99f01af0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1568 microversion: 2.1 time: 0.152452 May 23 15:43:24.413348 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 556/1097] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:24 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:24.478563 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:43:24.478563 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Mon May 23 15:43:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:43:25.430654 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-573c47c3-6ac7-41d3-8d15-14a1e5a89c12 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:25.432050 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-573c47c3-6ac7-41d3-8d15-14a1e5a89c12 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:25.438441 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-573c47c3-6ac7-41d3-8d15-14a1e5a89c12 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:25.438904 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-573c47c3-6ac7-41d3-8d15-14a1e5a89c12 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:25.439965 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-573c47c3-6ac7-41d3-8d15-14a1e5a89c12 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:25.440420 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-573c47c3-6ac7-41d3-8d15-14a1e5a89c12 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:25.568028 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-573c47c3-6ac7-41d3-8d15-14a1e5a89c12 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:25.575699 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-573c47c3-6ac7-41d3-8d15-14a1e5a89c12 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1568 microversion: 2.1 time: 0.149056 May 23 15:43:25.576269 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 542/1098] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:25 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:26.593847 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-748c1797-eac5-4d9c-92ea-b838f1c5eb71 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:26.594477 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-748c1797-eac5-4d9c-92ea-b838f1c5eb71 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:26.601178 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-748c1797-eac5-4d9c-92ea-b838f1c5eb71 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:26.601636 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-748c1797-eac5-4d9c-92ea-b838f1c5eb71 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:26.602409 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-748c1797-eac5-4d9c-92ea-b838f1c5eb71 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:26.602848 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-748c1797-eac5-4d9c-92ea-b838f1c5eb71 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:26.795741 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-748c1797-eac5-4d9c-92ea-b838f1c5eb71 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:26.803431 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-748c1797-eac5-4d9c-92ea-b838f1c5eb71 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1568 microversion: 2.1 time: 0.213594 May 23 15:43:26.804006 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 557/1099] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:26 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:27.820768 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d752d5eb-5b1a-4978-b0f6-44b7d73fec0f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:27.821437 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d752d5eb-5b1a-4978-b0f6-44b7d73fec0f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:27.828408 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d752d5eb-5b1a-4978-b0f6-44b7d73fec0f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:27.828886 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d752d5eb-5b1a-4978-b0f6-44b7d73fec0f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:27.829685 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d752d5eb-5b1a-4978-b0f6-44b7d73fec0f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:27.830140 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d752d5eb-5b1a-4978-b0f6-44b7d73fec0f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:27.964298 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d752d5eb-5b1a-4978-b0f6-44b7d73fec0f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:27.971817 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d752d5eb-5b1a-4978-b0f6-44b7d73fec0f tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1568 microversion: 2.1 time: 0.154942 May 23 15:43:27.972397 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 543/1100] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:27 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:28.989415 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-96576f0f-f165-40de-930e-0ed916d5848c tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:28.990034 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-96576f0f-f165-40de-930e-0ed916d5848c tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:28.997311 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96576f0f-f165-40de-930e-0ed916d5848c tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:28.997769 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96576f0f-f165-40de-930e-0ed916d5848c tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:28.998542 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96576f0f-f165-40de-930e-0ed916d5848c tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:28.998983 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-96576f0f-f165-40de-930e-0ed916d5848c tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:29.129905 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-96576f0f-f165-40de-930e-0ed916d5848c tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:29.138384 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-96576f0f-f165-40de-930e-0ed916d5848c tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1568 microversion: 2.1 time: 0.152785 May 23 15:43:29.138963 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 558/1101] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:28 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:30.156241 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-9d5c2978-008d-4934-8df6-4cee1ba11b84 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:30.156857 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-9d5c2978-008d-4934-8df6-4cee1ba11b84 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:30.163463 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9d5c2978-008d-4934-8df6-4cee1ba11b84 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:30.163893 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9d5c2978-008d-4934-8df6-4cee1ba11b84 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:30.164667 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9d5c2978-008d-4934-8df6-4cee1ba11b84 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:30.165116 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9d5c2978-008d-4934-8df6-4cee1ba11b84 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:30.291957 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9d5c2978-008d-4934-8df6-4cee1ba11b84 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:30.299666 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-9d5c2978-008d-4934-8df6-4cee1ba11b84 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1509 microversion: 2.1 time: 0.147063 May 23 15:43:30.300222 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 544/1102] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:30 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:30.316110 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a2dfa3b1-eaef-418a-8917-5bbe53cec503 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:30.316715 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a2dfa3b1-eaef-418a-8917-5bbe53cec503 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:30.323875 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a2dfa3b1-eaef-418a-8917-5bbe53cec503 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:30.324319 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a2dfa3b1-eaef-418a-8917-5bbe53cec503 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:30.325126 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a2dfa3b1-eaef-418a-8917-5bbe53cec503 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:30.325573 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a2dfa3b1-eaef-418a-8917-5bbe53cec503 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:30.413963 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a2dfa3b1-eaef-418a-8917-5bbe53cec503 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "POST /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899/action" status: 202 len: 0 microversion: 2.1 time: 0.101678 May 23 15:43:30.414855 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 559/1103] 10.222.0.30 () {60 vars in 1277 bytes} [Mon May 23 15:43:30 2022] POST /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:43:30.423431 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-b5eed189-90dd-45ee-ab5f-c311763bac00 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:30.424053 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-b5eed189-90dd-45ee-ab5f-c311763bac00 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:30.430514 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b5eed189-90dd-45ee-ab5f-c311763bac00 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:30.431499 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b5eed189-90dd-45ee-ab5f-c311763bac00 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:30.432494 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b5eed189-90dd-45ee-ab5f-c311763bac00 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:30.433044 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-b5eed189-90dd-45ee-ab5f-c311763bac00 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:30.599795 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-b5eed189-90dd-45ee-ab5f-c311763bac00 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:30.608921 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-b5eed189-90dd-45ee-ab5f-c311763bac00 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1517 microversion: 2.1 time: 0.189399 May 23 15:43:30.609514 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 545/1104] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:30 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:31.393815 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-d11d708d-d8f3-4498-8e05-75e50bb49b08 req-68a4e6d1-df6f-4804-93bf-91aeda9dfce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff4ee13-17c0-4b09-abc7-488e123e6899", "name": "network-vif-unplugged", "status": "completed", "tag": "300409dc-55b8-410d-b8c1-b461d6270c87"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:31.402387 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-d11d708d-d8f3-4498-8e05-75e50bb49b08 req-68a4e6d1-df6f-4804-93bf-91aeda9dfce1 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:31.402833 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-d11d708d-d8f3-4498-8e05-75e50bb49b08 req-68a4e6d1-df6f-4804-93bf-91aeda9dfce1 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:31.414030 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.compute.server_external_events [req-d11d708d-d8f3-4498-8e05-75e50bb49b08 req-68a4e6d1-df6f-4804-93bf-91aeda9dfce1 service nova] Unable to find a host for instance dff4ee13-17c0-4b09-abc7-488e123e6899. Dropping event network-vif-unplugged {{(pid=117974) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 23 15:43:31.414913 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-d11d708d-d8f3-4498-8e05-75e50bb49b08 req-68a4e6d1-df6f-4804-93bf-91aeda9dfce1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025423 May 23 15:43:31.415601 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 560/1105] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 23 15:43:31.626207 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-ee074834-82fe-4b99-bd87-6d51cd92e9eb tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:31.626758 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-ee074834-82fe-4b99-bd87-6d51cd92e9eb tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:31.633840 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ee074834-82fe-4b99-bd87-6d51cd92e9eb tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:31.634293 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ee074834-82fe-4b99-bd87-6d51cd92e9eb tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:31.635585 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ee074834-82fe-4b99-bd87-6d51cd92e9eb tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:31.636024 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-ee074834-82fe-4b99-bd87-6d51cd92e9eb tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:31.772665 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-ee074834-82fe-4b99-bd87-6d51cd92e9eb tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:31.780992 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-ee074834-82fe-4b99-bd87-6d51cd92e9eb tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1519 microversion: 2.1 time: 0.158676 May 23 15:43:31.781569 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 546/1106] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:31 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:32.799805 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-010e4d47-b3f7-4d75-b5ee-95bca99d9a5a tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:32.800478 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-010e4d47-b3f7-4d75-b5ee-95bca99d9a5a tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:32.807893 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-010e4d47-b3f7-4d75-b5ee-95bca99d9a5a tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:32.808340 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-010e4d47-b3f7-4d75-b5ee-95bca99d9a5a tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:32.809153 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-010e4d47-b3f7-4d75-b5ee-95bca99d9a5a tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:32.809593 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-010e4d47-b3f7-4d75-b5ee-95bca99d9a5a tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:32.996555 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-010e4d47-b3f7-4d75-b5ee-95bca99d9a5a tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:33.004190 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-010e4d47-b3f7-4d75-b5ee-95bca99d9a5a tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1575 microversion: 2.1 time: 0.208526 May 23 15:43:33.004915 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 561/1107] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:32 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1575 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:34.021981 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-cd499040-50bc-4f0e-937a-e1d7746c0fdb tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:34.022633 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-cd499040-50bc-4f0e-937a-e1d7746c0fdb tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:34.030066 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cd499040-50bc-4f0e-937a-e1d7746c0fdb tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:34.030524 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cd499040-50bc-4f0e-937a-e1d7746c0fdb tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:34.031298 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cd499040-50bc-4f0e-937a-e1d7746c0fdb tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:34.031748 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-cd499040-50bc-4f0e-937a-e1d7746c0fdb tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:34.159235 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-cd499040-50bc-4f0e-937a-e1d7746c0fdb tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:34.166901 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-cd499040-50bc-4f0e-937a-e1d7746c0fdb tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1575 microversion: 2.1 time: 0.148837 May 23 15:43:34.167472 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 547/1108] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:34 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:35.184672 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-770d1d72-1d21-4ccf-a5f4-b69d191158e6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:35.185332 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-770d1d72-1d21-4ccf-a5f4-b69d191158e6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:35.191923 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-770d1d72-1d21-4ccf-a5f4-b69d191158e6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:35.192378 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-770d1d72-1d21-4ccf-a5f4-b69d191158e6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:35.193176 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-770d1d72-1d21-4ccf-a5f4-b69d191158e6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:35.193618 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-770d1d72-1d21-4ccf-a5f4-b69d191158e6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:35.321865 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-770d1d72-1d21-4ccf-a5f4-b69d191158e6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:35.329291 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-770d1d72-1d21-4ccf-a5f4-b69d191158e6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1575 microversion: 2.1 time: 0.149077 May 23 15:43:35.329859 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 562/1109] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:35 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:36.346276 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-f8edd65d-05d5-4dbf-9e10-98084f45acb0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:36.346891 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-f8edd65d-05d5-4dbf-9e10-98084f45acb0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:36.354013 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f8edd65d-05d5-4dbf-9e10-98084f45acb0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:36.354490 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f8edd65d-05d5-4dbf-9e10-98084f45acb0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:36.355297 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f8edd65d-05d5-4dbf-9e10-98084f45acb0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:36.355734 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-f8edd65d-05d5-4dbf-9e10-98084f45acb0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:36.484135 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-f8edd65d-05d5-4dbf-9e10-98084f45acb0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:36.491729 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-f8edd65d-05d5-4dbf-9e10-98084f45acb0 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1575 microversion: 2.1 time: 0.149264 May 23 15:43:36.492234 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 548/1110] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:36 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:37.509733 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-38088167-e2b2-4b83-a3ee-9b0c888e6d76 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:37.510440 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-38088167-e2b2-4b83-a3ee-9b0c888e6d76 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:37.517044 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-38088167-e2b2-4b83-a3ee-9b0c888e6d76 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:37.517500 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-38088167-e2b2-4b83-a3ee-9b0c888e6d76 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:37.518268 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-38088167-e2b2-4b83-a3ee-9b0c888e6d76 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:37.518708 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-38088167-e2b2-4b83-a3ee-9b0c888e6d76 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:37.650844 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-38088167-e2b2-4b83-a3ee-9b0c888e6d76 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:37.658401 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-38088167-e2b2-4b83-a3ee-9b0c888e6d76 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1575 microversion: 2.1 time: 0.152643 May 23 15:43:37.658971 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 563/1111] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:37 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:38.676113 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-9bd6be66-f342-4dc5-8343-f8589e40b938 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:38.676757 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-9bd6be66-f342-4dc5-8343-f8589e40b938 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:38.683843 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9bd6be66-f342-4dc5-8343-f8589e40b938 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:38.684299 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9bd6be66-f342-4dc5-8343-f8589e40b938 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:38.685087 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9bd6be66-f342-4dc5-8343-f8589e40b938 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:38.685531 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-9bd6be66-f342-4dc5-8343-f8589e40b938 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:38.815466 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-9bd6be66-f342-4dc5-8343-f8589e40b938 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:38.823670 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-9bd6be66-f342-4dc5-8343-f8589e40b938 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1575 microversion: 2.1 time: 0.151700 May 23 15:43:38.824234 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 549/1112] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:38 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:39.841685 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-6d7f5718-f20e-4fe2-b51e-42c010611c22 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:39.842311 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-6d7f5718-f20e-4fe2-b51e-42c010611c22 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:39.848776 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6d7f5718-f20e-4fe2-b51e-42c010611c22 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:39.849267 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6d7f5718-f20e-4fe2-b51e-42c010611c22 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:39.850047 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6d7f5718-f20e-4fe2-b51e-42c010611c22 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:39.850491 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-6d7f5718-f20e-4fe2-b51e-42c010611c22 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:39.994216 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-6d7f5718-f20e-4fe2-b51e-42c010611c22 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:40.002473 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-6d7f5718-f20e-4fe2-b51e-42c010611c22 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1575 microversion: 2.1 time: 0.165370 May 23 15:43:40.003052 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 564/1113] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:39 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:41.019947 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-61002ca8-8f2e-49db-8cc3-a6153a8af501 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:41.020558 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-61002ca8-8f2e-49db-8cc3-a6153a8af501 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:41.028400 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-61002ca8-8f2e-49db-8cc3-a6153a8af501 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:41.028847 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-61002ca8-8f2e-49db-8cc3-a6153a8af501 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:41.029643 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-61002ca8-8f2e-49db-8cc3-a6153a8af501 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:41.030079 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-61002ca8-8f2e-49db-8cc3-a6153a8af501 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:41.159893 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-61002ca8-8f2e-49db-8cc3-a6153a8af501 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:41.168203 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-61002ca8-8f2e-49db-8cc3-a6153a8af501 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1575 microversion: 2.1 time: 0.152116 May 23 15:43:41.168785 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 550/1114] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:41 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:41.479953 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-cd3ad757-b09a-4d13-918b-f9ae98d5053d req-28694669-5edf-43b5-a175-300bf0506778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff4ee13-17c0-4b09-abc7-488e123e6899", "name": "network-vif-plugged", "status": "completed", "tag": "300409dc-55b8-410d-b8c1-b461d6270c87"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:41.488571 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-cd3ad757-b09a-4d13-918b-f9ae98d5053d req-28694669-5edf-43b5-a175-300bf0506778 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:41.489059 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-cd3ad757-b09a-4d13-918b-f9ae98d5053d req-28694669-5edf-43b5-a175-300bf0506778 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:41.501979 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-cd3ad757-b09a-4d13-918b-f9ae98d5053d req-28694669-5edf-43b5-a175-300bf0506778 service nova] Creating event network-vif-plugged:300409dc-55b8-410d-b8c1-b461d6270c87 for instance dff4ee13-17c0-4b09-abc7-488e123e6899 on hv-cinder-84112 May 23 15:43:41.506882 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-cd3ad757-b09a-4d13-918b-f9ae98d5053d req-28694669-5edf-43b5-a175-300bf0506778 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031138 May 23 15:43:41.507646 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 565/1115] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:43:42.185448 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-5672d0bb-13ae-4818-a06f-2af9bea1a054 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:42.186067 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-5672d0bb-13ae-4818-a06f-2af9bea1a054 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:42.192566 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5672d0bb-13ae-4818-a06f-2af9bea1a054 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:42.193054 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5672d0bb-13ae-4818-a06f-2af9bea1a054 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:42.193819 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5672d0bb-13ae-4818-a06f-2af9bea1a054 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:42.194258 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-5672d0bb-13ae-4818-a06f-2af9bea1a054 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:42.345511 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-5672d0bb-13ae-4818-a06f-2af9bea1a054 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:42.353798 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-5672d0bb-13ae-4818-a06f-2af9bea1a054 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1575 microversion: 2.1 time: 0.172235 May 23 15:43:42.354377 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 551/1116] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:42 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:43.372898 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-abb351f8-b5bf-430a-a293-c98ae1b9234b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:43.373640 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-abb351f8-b5bf-430a-a293-c98ae1b9234b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:43.379874 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-abb351f8-b5bf-430a-a293-c98ae1b9234b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:43.380328 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-abb351f8-b5bf-430a-a293-c98ae1b9234b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:43.381131 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-abb351f8-b5bf-430a-a293-c98ae1b9234b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:43.381580 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-abb351f8-b5bf-430a-a293-c98ae1b9234b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:43.516771 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-abb351f8-b5bf-430a-a293-c98ae1b9234b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:43.520219 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:43.525235 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-abb351f8-b5bf-430a-a293-c98ae1b9234b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1562 microversion: 2.1 time: 0.157820 May 23 15:43:43.525792 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 566/1117] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:43:43 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:28.068749 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-4c6f9d17-4890-4327-a689-1fe1b627cf55 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:28.069431 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-4c6f9d17-4890-4327-a689-1fe1b627cf55 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:28.070020 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-99cfccee-82f0-4bf4-90ae-177838959c48 req-0c8aea96-a780-4cc1-8c36-7d0ecc330573 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b9f2c7-9802-4ba9-9cca-a5725bae68e6", "tag": "0a474cc8-872c-46fc-ad61-6c4536ac5bac"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:44:28.071662 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=28 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:28.072475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=84 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:28.074183 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=32 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:28.078968 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4c6f9d17-4890-4327-a689-1fe1b627cf55 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:28.079876 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4c6f9d17-4890-4327-a689-1fe1b627cf55 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:28.080449 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-99cfccee-82f0-4bf4-90ae-177838959c48 req-0c8aea96-a780-4cc1-8c36-7d0ecc330573 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:28.080974 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-99cfccee-82f0-4bf4-90ae-177838959c48 req-0c8aea96-a780-4cc1-8c36-7d0ecc330573 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:28.081288 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4c6f9d17-4890-4327-a689-1fe1b627cf55 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:28.081807 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-4c6f9d17-4890-4327-a689-1fe1b627cf55 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:28.093887 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-99cfccee-82f0-4bf4-90ae-177838959c48 req-0c8aea96-a780-4cc1-8c36-7d0ecc330573 service nova] Creating event network-changed:0a474cc8-872c-46fc-ad61-6c4536ac5bac for instance 83b9f2c7-9802-4ba9-9cca-a5725bae68e6 on hv-cinder-84112 May 23 15:44:28.099656 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-99cfccee-82f0-4bf4-90ae-177838959c48 req-0c8aea96-a780-4cc1-8c36-7d0ecc330573 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033472 May 23 15:44:28.100516 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 567/1118] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:44:28.110286 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-4c6f9d17-4890-4327-a689-1fe1b627cf55 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Going to try to terminate instance {{(pid=117973) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:44:28.196568 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-4c6f9d17-4890-4327-a689-1fe1b627cf55 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "DELETE /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 204 len: 0 microversion: 2.1 time: 0.132910 May 23 15:44:28.197596 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 552/1119] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:44:28 2022] DELETE /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:44:28.206539 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-81f34145-885b-4704-976b-65a5f3898635 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:28.207588 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-81f34145-885b-4704-976b-65a5f3898635 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:28.214432 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-81f34145-885b-4704-976b-65a5f3898635 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:28.214980 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-81f34145-885b-4704-976b-65a5f3898635 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:28.216447 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-81f34145-885b-4704-976b-65a5f3898635 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:28.216999 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-81f34145-885b-4704-976b-65a5f3898635 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:28.389148 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-81f34145-885b-4704-976b-65a5f3898635 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:28.396987 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-81f34145-885b-4704-976b-65a5f3898635 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1578 microversion: 2.1 time: 0.194860 May 23 15:44:28.397562 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 568/1120] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:44:28 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1578 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:29.415406 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-7904a5bb-7f16-41c9-818c-c5d4119949fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:29.416120 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-7904a5bb-7f16-41c9-818c-c5d4119949fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:29.423366 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7904a5bb-7f16-41c9-818c-c5d4119949fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:29.423829 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7904a5bb-7f16-41c9-818c-c5d4119949fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:29.424610 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7904a5bb-7f16-41c9-818c-c5d4119949fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:29.425081 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-7904a5bb-7f16-41c9-818c-c5d4119949fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:29.553999 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-7904a5bb-7f16-41c9-818c-c5d4119949fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:29.561549 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-7904a5bb-7f16-41c9-818c-c5d4119949fe tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1578 microversion: 2.1 time: 0.150793 May 23 15:44:29.562126 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 553/1121] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:44:29 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:30.546761 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-4fd5694b-7e9c-4a61-99a8-d7f82dbe5e0e req-1cb7ddac-b563-414d-9a15-60fe5a567755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b9f2c7-9802-4ba9-9cca-a5725bae68e6", "name": "network-vif-deleted", "tag": "0a474cc8-872c-46fc-ad61-6c4536ac5bac"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:44:30.557997 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-4fd5694b-7e9c-4a61-99a8-d7f82dbe5e0e req-1cb7ddac-b563-414d-9a15-60fe5a567755 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:30.558378 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-4fd5694b-7e9c-4a61-99a8-d7f82dbe5e0e req-1cb7ddac-b563-414d-9a15-60fe5a567755 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:30.570582 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-4fd5694b-7e9c-4a61-99a8-d7f82dbe5e0e req-1cb7ddac-b563-414d-9a15-60fe5a567755 service nova] Creating event network-vif-deleted:0a474cc8-872c-46fc-ad61-6c4536ac5bac for instance 83b9f2c7-9802-4ba9-9cca-a5725bae68e6 on hv-cinder-84112 May 23 15:44:30.575715 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-4fd5694b-7e9c-4a61-99a8-d7f82dbe5e0e req-1cb7ddac-b563-414d-9a15-60fe5a567755 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032625 May 23 15:44:30.576448 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 569/1122] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:44:30.580180 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-c9e1f608-c31b-4638-a441-746d9601084b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:30.580811 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-c9e1f608-c31b-4638-a441-746d9601084b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:30.587498 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c9e1f608-c31b-4638-a441-746d9601084b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:30.587960 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c9e1f608-c31b-4638-a441-746d9601084b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:30.588748 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c9e1f608-c31b-4638-a441-746d9601084b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:30.589223 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-c9e1f608-c31b-4638-a441-746d9601084b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:30.651475 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-c9e1f608-c31b-4638-a441-746d9601084b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:30.659843 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-c9e1f608-c31b-4638-a441-746d9601084b tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 200 len: 1226 microversion: 2.1 time: 0.084371 May 23 15:44:30.660420 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 554/1123] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:44:30 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:44:31.727850 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f3b897c2-35dd-475a-8ec4-2c144ff538a1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:31.728591 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-f3b897c2-35dd-475a-8ec4-2c144ff538a1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: 83b9f2c7-9802-4ba9-9cca-a5725bae68e6] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:31.736161 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f3b897c2-35dd-475a-8ec4-2c144ff538a1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:31.736619 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f3b897c2-35dd-475a-8ec4-2c144ff538a1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:31.737432 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f3b897c2-35dd-475a-8ec4-2c144ff538a1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:31.737879 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-f3b897c2-35dd-475a-8ec4-2c144ff538a1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:31.751332 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-f3b897c2-35dd-475a-8ec4-2c144ff538a1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] HTTP exception thrown: Instance 83b9f2c7-9802-4ba9-9cca-a5725bae68e6 could not be found. May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f3b897c2-35dd-475a-8ec4-2c144ff538a1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Request method failure captured: May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 HTTP/1.1 May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6pPFnhlP44DlfuZrn540KEsk_GxJuq9-d_HlUj6EEkhA-bQLGUE7ndnaGOKCmgc4xgLds2HqsgLwPEmSOPp_FU5I-qmEQbzOcp36wyR06FFOjH7CrEFM21bcouHIAFcSL0REveSkVwh-kctrNivJ0yFWMwYK8Zen5BZJOgYoslrHQo May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 449514f02fbc485484110bde5a2018c0 May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-TestVolumeBootPattern-1083421479 May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:44:31.752969 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:44:31.754677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/449514f02fbc485484110bde5a2018c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/449514f02fbc485484110bde5a2018c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/449514f02fbc485484110bde5a2018c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_449514f02fbc485484110bde5a2018c0", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:44:31.754677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-TestVolumeBootPattern-1083421479 May 23 15:44:31.754677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 449514f02fbc485484110bde5a2018c0 May 23 15:44:31.754677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-TestVolumeBootPattern-1083421479 May 23 15:44:31.754677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-TestVolumeBootPattern-1083421479-project May 23 15:44:31.754677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:44:31.754677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:44:31.754677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 01d7c2fa381541139ea7aebaf2ae688f May 23 15:44:31.754677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-TestVolumeBootPattern-1083421479-project May 23 15:44:31.754677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:44:31.754677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance 83b9f2c7-9802-4ba9-9cca-a5725bae68e6 could not be found. May 23 15:44:31.754677 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': '83b9f2c7-9802-4ba9-9cca-a5725bae68e6'} May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83b9f2c7-9802-4ba9-9cca-a5725bae68e6 could not be found. May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:44:31.755633 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83b9f2c7-9802-4ba9-9cca-a5725bae68e6 could not be found. May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83b9f2c7-9802-4ba9-9cca-a5725bae68e6 could not be found. May 23 15:44:31.757261 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:44:31.758655 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-f3b897c2-35dd-475a-8ec4-2c144ff538a1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Returning 404 to user: Instance 83b9f2c7-9802-4ba9-9cca-a5725bae68e6 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:44:31.758655 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-f3b897c2-35dd-475a-8ec4-2c144ff538a1 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6" status: 404 len: 111 microversion: 2.1 time: 0.030767 May 23 15:44:31.758655 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 570/1124] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:44:31 2022] GET /compute/v2.1/servers/83b9f2c7-9802-4ba9-9cca-a5725bae68e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:44:34.803739 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-8613490f-8637-41be-9c7c-aa6f6386b558 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:34.804326 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8613490f-8637-41be-9c7c-aa6f6386b558 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:34.807049 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-56ed3464-4e9c-485c-b438-0f4aba69b211 req-62b4bd7f-8bfd-4b5d-b76d-290997fd1970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca2fa96-252e-4d26-87eb-74cee3ee6c7d", "tag": "0a916c19-f60f-4185-8d5c-62020d7bdb15"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:44:34.811217 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8613490f-8637-41be-9c7c-aa6f6386b558 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:34.811920 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8613490f-8637-41be-9c7c-aa6f6386b558 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:34.813148 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8613490f-8637-41be-9c7c-aa6f6386b558 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:34.813591 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-8613490f-8637-41be-9c7c-aa6f6386b558 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:34.815248 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-56ed3464-4e9c-485c-b438-0f4aba69b211 req-62b4bd7f-8bfd-4b5d-b76d-290997fd1970 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:34.815691 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-56ed3464-4e9c-485c-b438-0f4aba69b211 req-62b4bd7f-8bfd-4b5d-b76d-290997fd1970 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:34.827095 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-56ed3464-4e9c-485c-b438-0f4aba69b211 req-62b4bd7f-8bfd-4b5d-b76d-290997fd1970 service nova] Creating event network-changed:0a916c19-f60f-4185-8d5c-62020d7bdb15 for instance eca2fa96-252e-4d26-87eb-74cee3ee6c7d on hv-cinder-84112 May 23 15:44:34.833156 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-56ed3464-4e9c-485c-b438-0f4aba69b211 req-62b4bd7f-8bfd-4b5d-b76d-290997fd1970 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030177 May 23 15:44:34.833743 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 571/1125] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:44:34.839698 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-8613490f-8637-41be-9c7c-aa6f6386b558 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] Going to try to terminate instance {{(pid=117973) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:44:34.927496 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-8613490f-8637-41be-9c7c-aa6f6386b558 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "DELETE /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d" status: 204 len: 0 microversion: 2.1 time: 0.126730 May 23 15:44:34.931764 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 555/1126] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:44:34 2022] DELETE /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:44:34.938118 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-25535755-d15d-4613-8840-08c9deece590 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:34.938836 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-25535755-d15d-4613-8840-08c9deece590 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:34.947767 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-25535755-d15d-4613-8840-08c9deece590 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:34.948227 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-25535755-d15d-4613-8840-08c9deece590 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:34.949051 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-25535755-d15d-4613-8840-08c9deece590 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:34.949579 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-25535755-d15d-4613-8840-08c9deece590 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:35.127917 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-25535755-d15d-4613-8840-08c9deece590 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:35.135788 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-25535755-d15d-4613-8840-08c9deece590 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d" status: 200 len: 1577 microversion: 2.1 time: 0.202342 May 23 15:44:35.136446 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 572/1127] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:44:34 2022] GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d => generated 1577 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:36.154721 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-42849287-6b38-462c-bb0f-81eda6e8d67c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:36.155350 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-42849287-6b38-462c-bb0f-81eda6e8d67c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:36.162595 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-42849287-6b38-462c-bb0f-81eda6e8d67c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:36.163052 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-42849287-6b38-462c-bb0f-81eda6e8d67c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:36.163828 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-42849287-6b38-462c-bb0f-81eda6e8d67c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:36.164272 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-42849287-6b38-462c-bb0f-81eda6e8d67c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:36.298698 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-42849287-6b38-462c-bb0f-81eda6e8d67c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:36.306263 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-42849287-6b38-462c-bb0f-81eda6e8d67c tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d" status: 200 len: 1577 microversion: 2.1 time: 0.155895 May 23 15:44:36.306837 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 556/1128] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:44:36 2022] GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:37.322932 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-9a27b9c6-6829-4a8a-a500-633b466761fc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:37.323554 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-9a27b9c6-6829-4a8a-a500-633b466761fc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:37.330100 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9a27b9c6-6829-4a8a-a500-633b466761fc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:37.330555 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9a27b9c6-6829-4a8a-a500-633b466761fc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:37.331327 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9a27b9c6-6829-4a8a-a500-633b466761fc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:37.331850 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-9a27b9c6-6829-4a8a-a500-633b466761fc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:37.420477 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-9a27b9c6-6829-4a8a-a500-633b466761fc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d7c2fa381541139ea7aebaf2ae688f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449514f02fbc485484110bde5a2018c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:37.430521 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-9a27b9c6-6829-4a8a-a500-633b466761fc tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d" status: 200 len: 1391 microversion: 2.1 time: 0.111438 May 23 15:44:37.431108 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 573/1129] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:44:37 2022] GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d => generated 1391 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:37.451552 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-df86adef-57af-49b0-9ad1-a177b1cd5ee0 req-c21f6ec7-69b1-46dc-8a4c-c6d84e3d3cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca2fa96-252e-4d26-87eb-74cee3ee6c7d", "name": "network-vif-deleted", "tag": "0a916c19-f60f-4185-8d5c-62020d7bdb15"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:44:37.460751 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-df86adef-57af-49b0-9ad1-a177b1cd5ee0 req-c21f6ec7-69b1-46dc-8a4c-c6d84e3d3cf1 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:37.461233 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-df86adef-57af-49b0-9ad1-a177b1cd5ee0 req-c21f6ec7-69b1-46dc-8a4c-c6d84e3d3cf1 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:37.472884 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-df86adef-57af-49b0-9ad1-a177b1cd5ee0 req-c21f6ec7-69b1-46dc-8a4c-c6d84e3d3cf1 service nova] Creating event network-vif-deleted:0a916c19-f60f-4185-8d5c-62020d7bdb15 for instance eca2fa96-252e-4d26-87eb-74cee3ee6c7d on hv-cinder-84112 May 23 15:44:37.477916 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-df86adef-57af-49b0-9ad1-a177b1cd5ee0 req-c21f6ec7-69b1-46dc-8a4c-c6d84e3d3cf1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030138 May 23 15:44:37.478659 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 557/1130] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:44:38.447649 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-26173e71-d2be-4c69-8336-b9679d41b79a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:38.448228 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-26173e71-d2be-4c69-8336-b9679d41b79a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: eca2fa96-252e-4d26-87eb-74cee3ee6c7d] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:38.456832 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-26173e71-d2be-4c69-8336-b9679d41b79a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:38.457143 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-26173e71-d2be-4c69-8336-b9679d41b79a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:38.457938 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-26173e71-d2be-4c69-8336-b9679d41b79a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:38.458478 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-26173e71-d2be-4c69-8336-b9679d41b79a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:38.472857 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-26173e71-d2be-4c69-8336-b9679d41b79a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] HTTP exception thrown: Instance eca2fa96-252e-4d26-87eb-74cee3ee6c7d could not be found. May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-26173e71-d2be-4c69-8336-b9679d41b79a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Request method failure captured: May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d HTTP/1.1 May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6pPFnhlP44DlfuZrn540KEsk_GxJuq9-d_HlUj6EEkhA-bQLGUE7ndnaGOKCmgc4xgLds2HqsgLwPEmSOPp_FU5I-qmEQbzOcp36wyR06FFOjH7CrEFM21bcouHIAFcSL0REveSkVwh-kctrNivJ0yFWMwYK8Zen5BZJOgYoslrHQo May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 449514f02fbc485484110bde5a2018c0 May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-TestVolumeBootPattern-1083421479 May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:44:38.474536 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:44:38.476145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/449514f02fbc485484110bde5a2018c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/449514f02fbc485484110bde5a2018c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/449514f02fbc485484110bde5a2018c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_449514f02fbc485484110bde5a2018c0", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:44:38.476145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-TestVolumeBootPattern-1083421479 May 23 15:44:38.476145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 449514f02fbc485484110bde5a2018c0 May 23 15:44:38.476145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-TestVolumeBootPattern-1083421479 May 23 15:44:38.476145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-TestVolumeBootPattern-1083421479-project May 23 15:44:38.476145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:44:38.476145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:44:38.476145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 01d7c2fa381541139ea7aebaf2ae688f May 23 15:44:38.476145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-TestVolumeBootPattern-1083421479-project May 23 15:44:38.476145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:44:38.476145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance eca2fa96-252e-4d26-87eb-74cee3ee6c7d could not be found. May 23 15:44:38.476145 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': 'eca2fa96-252e-4d26-87eb-74cee3ee6c7d'} May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca2fa96-252e-4d26-87eb-74cee3ee6c7d could not be found. May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:44:38.477045 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca2fa96-252e-4d26-87eb-74cee3ee6c7d could not be found. May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca2fa96-252e-4d26-87eb-74cee3ee6c7d could not be found. May 23 15:44:38.478341 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:44:38.479491 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-26173e71-d2be-4c69-8336-b9679d41b79a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Returning 404 to user: Instance eca2fa96-252e-4d26-87eb-74cee3ee6c7d could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:44:38.479491 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-26173e71-d2be-4c69-8336-b9679d41b79a tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d" status: 404 len: 111 microversion: 2.1 time: 0.032321 May 23 15:44:38.479491 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 574/1131] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:44:38 2022] GET /compute/v2.1/servers/eca2fa96-252e-4d26-87eb-74cee3ee6c7d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:44:38.918501 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-2e66f3a4-09b2-4c04-9adf-20fc3fda8e45 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:38.919097 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-2e66f3a4-09b2-4c04-9adf-20fc3fda8e45 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:38.926182 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2e66f3a4-09b2-4c04-9adf-20fc3fda8e45 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:38.926637 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2e66f3a4-09b2-4c04-9adf-20fc3fda8e45 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:38.927409 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2e66f3a4-09b2-4c04-9adf-20fc3fda8e45 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:38.927855 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-2e66f3a4-09b2-4c04-9adf-20fc3fda8e45 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:38.941152 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.wsgi [None req-2e66f3a4-09b2-4c04-9adf-20fc3fda8e45 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] HTTP exception thrown: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-2e66f3a4-09b2-4c04-9adf-20fc3fda8e45 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Request method failure captured: May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: request: DELETE /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c HTTP/1.1 May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept: application/json May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Accept-Encoding: identity May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Connection: close May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Length: 0 May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Content-Type: application/json May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Host: 10.222.0.30 May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Openstack-System-Scope: None May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: User-Agent: python-urllib3/1.26.9 May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Auth-Token: gAAAAABii6pPFnhlP44DlfuZrn540KEsk_GxJuq9-d_HlUj6EEkhA-bQLGUE7ndnaGOKCmgc4xgLds2HqsgLwPEmSOPp_FU5I-qmEQbzOcp36wyR06FFOjH7CrEFM21bcouHIAFcSL0REveSkVwh-kctrNivJ0yFWMwYK8Zen5BZJOgYoslrHQo May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Id: None May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Domain-Name: None May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Identity-Status: Confirmed May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Is-Admin-Project: True May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Id: default May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Domain-Name: Default May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Id: 449514f02fbc485484110bde5a2018c0 May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Project-Name: tempest-TestVolumeBootPattern-1083421479 May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Role: member,reader May 23 15:44:38.942779 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Roles: member,reader May 23 15:44:38.944412 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/449514f02fbc485484110bde5a2018c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/449514f02fbc485484110bde5a2018c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/449514f02fbc485484110bde5a2018c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_449514f02fbc485484110bde5a2018c0", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:44:38.944412 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant: tempest-TestVolumeBootPattern-1083421479 May 23 15:44:38.944412 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Id: 449514f02fbc485484110bde5a2018c0 May 23 15:44:38.944412 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-Tenant-Name: tempest-TestVolumeBootPattern-1083421479 May 23 15:44:38.944412 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User: tempest-TestVolumeBootPattern-1083421479-project May 23 15:44:38.944412 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Id: default May 23 15:44:38.944412 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Domain-Name: Default May 23 15:44:38.944412 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Id: 01d7c2fa381541139ea7aebaf2ae688f May 23 15:44:38.944412 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: X-User-Name: tempest-TestVolumeBootPattern-1083421479-project May 23 15:44:38.944412 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: method: > May 23 15:44:38.944412 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: exception: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. May 23 15:44:38.944412 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: action_args: {'id': 'd3cec2db-2c9e-4056-91b1-e16f4981811c'} May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:44:38.945388 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. May 23 15:44:38.946792 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: ERROR nova.api.openstack.wsgi May 23 15:44:38.948175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-2e66f3a4-09b2-4c04-9adf-20fc3fda8e45 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Returning 404 to user: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. {{(pid=117973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:44:38.948175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-2e66f3a4-09b2-4c04-9adf-20fc3fda8e45 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 404 len: 111 microversion: 2.1 time: 0.030747 May 23 15:44:38.948175 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 558/1132] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:44:38 2022] DELETE /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:44:38.953739 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a9ab3c57-2767-4531-b100-19ff5f7b0ded tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:38.954358 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-a9ab3c57-2767-4531-b100-19ff5f7b0ded tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] [instance: d3cec2db-2c9e-4056-91b1-e16f4981811c] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:38.960511 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a9ab3c57-2767-4531-b100-19ff5f7b0ded tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:38.961002 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a9ab3c57-2767-4531-b100-19ff5f7b0ded tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:38.961764 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a9ab3c57-2767-4531-b100-19ff5f7b0ded tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:38.962200 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-a9ab3c57-2767-4531-b100-19ff5f7b0ded tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:38.975859 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-a9ab3c57-2767-4531-b100-19ff5f7b0ded tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] HTTP exception thrown: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a9ab3c57-2767-4531-b100-19ff5f7b0ded tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Request method failure captured: May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c HTTP/1.1 May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6pPFnhlP44DlfuZrn540KEsk_GxJuq9-d_HlUj6EEkhA-bQLGUE7ndnaGOKCmgc4xgLds2HqsgLwPEmSOPp_FU5I-qmEQbzOcp36wyR06FFOjH7CrEFM21bcouHIAFcSL0REveSkVwh-kctrNivJ0yFWMwYK8Zen5BZJOgYoslrHQo May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: 449514f02fbc485484110bde5a2018c0 May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-TestVolumeBootPattern-1083421479 May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:44:38.977397 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:44:38.979096 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/449514f02fbc485484110bde5a2018c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/449514f02fbc485484110bde5a2018c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/449514f02fbc485484110bde5a2018c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_449514f02fbc485484110bde5a2018c0", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:44:38.979096 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-TestVolumeBootPattern-1083421479 May 23 15:44:38.979096 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: 449514f02fbc485484110bde5a2018c0 May 23 15:44:38.979096 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-TestVolumeBootPattern-1083421479 May 23 15:44:38.979096 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-TestVolumeBootPattern-1083421479-project May 23 15:44:38.979096 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:44:38.979096 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:44:38.979096 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: 01d7c2fa381541139ea7aebaf2ae688f May 23 15:44:38.979096 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-TestVolumeBootPattern-1083421479-project May 23 15:44:38.979096 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:44:38.979096 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. May 23 15:44:38.979096 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': 'd3cec2db-2c9e-4056-91b1-e16f4981811c'} May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:44:38.980039 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. May 23 15:44:38.981569 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:44:38.982880 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-a9ab3c57-2767-4531-b100-19ff5f7b0ded tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Returning 404 to user: Instance d3cec2db-2c9e-4056-91b1-e16f4981811c could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:44:38.982880 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-a9ab3c57-2767-4531-b100-19ff5f7b0ded tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c" status: 404 len: 111 microversion: 2.1 time: 0.029172 May 23 15:44:38.982880 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 575/1133] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:44:38 2022] GET /compute/v2.1/servers/d3cec2db-2c9e-4056-91b1-e16f4981811c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:44:40.261747 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-9ecaa654-ba88-46bc-8d36-7aec7978f0f8 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] Calling method '.version_select at 0x7f0d7a208820>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:40.282373 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-9ecaa654-ba88-46bc-8d36-7aec7978f0f8 tempest-TestVolumeBootPattern-1083421479 tempest-TestVolumeBootPattern-1083421479-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1729280906" status: 202 len: 0 microversion: 2.1 time: 0.024355 May 23 15:44:40.282935 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 559/1134] 10.222.0.30 () {58 vars in 1262 bytes} [Mon May 23 15:44:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1729280906 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:45:03.429631 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:03.430269 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-cfc77b5d-ede7-4f40-a3b5-7c71dc6ef16e tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:03.430651 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-cfc77b5d-ede7-4f40-a3b5-7c71dc6ef16e tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:03.430749 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG dbcounter [-] [117973] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117973) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:03.434070 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_api:SELECT=18 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:03.434716 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG dbcounter [-] [117974] Writing DB stats nova_cell1:SELECT=30 {{(pid=117974) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:03.442169 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-cfc77b5d-ede7-4f40-a3b5-7c71dc6ef16e tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:03.442673 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-cfc77b5d-ede7-4f40-a3b5-7c71dc6ef16e tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:03.443439 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-cfc77b5d-ede7-4f40-a3b5-7c71dc6ef16e tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:03.443880 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-cfc77b5d-ede7-4f40-a3b5-7c71dc6ef16e tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:03.471392 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-cfc77b5d-ede7-4f40-a3b5-7c71dc6ef16e tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Going to try to terminate instance {{(pid=117974) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:45:03.565725 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-cfc77b5d-ede7-4f40-a3b5-7c71dc6ef16e tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 204 len: 0 microversion: 2.1 time: 0.138511 May 23 15:45:03.566367 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 576/1135] 10.222.0.30 () {58 vars in 1238 bytes} [Mon May 23 15:45:03 2022] DELETE /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:45:03.575631 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-4d66c4cf-6317-48cc-8b04-928ef4e70e71 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:03.576374 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-4d66c4cf-6317-48cc-8b04-928ef4e70e71 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:03.582442 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4d66c4cf-6317-48cc-8b04-928ef4e70e71 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:03.582892 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4d66c4cf-6317-48cc-8b04-928ef4e70e71 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:03.584049 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4d66c4cf-6317-48cc-8b04-928ef4e70e71 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:03.584489 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-4d66c4cf-6317-48cc-8b04-928ef4e70e71 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:03.668693 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [req-8d4e53d8-20d0-4872-88d5-678cf5417ad9 req-1510e77c-e1d4-4c4f-a083-99b39e78e863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dff4ee13-17c0-4b09-abc7-488e123e6899", "tag": "300409dc-55b8-410d-b8c1-b461d6270c87"}]} {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:03.677701 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-8d4e53d8-20d0-4872-88d5-678cf5417ad9 req-1510e77c-e1d4-4c4f-a083-99b39e78e863 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:03.678144 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [req-8d4e53d8-20d0-4872-88d5-678cf5417ad9 req-1510e77c-e1d4-4c4f-a083-99b39e78e863 service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:03.689008 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.compute.server_external_events [req-8d4e53d8-20d0-4872-88d5-678cf5417ad9 req-1510e77c-e1d4-4c4f-a083-99b39e78e863 service nova] Creating event network-changed:300409dc-55b8-410d-b8c1-b461d6270c87 for instance dff4ee13-17c0-4b09-abc7-488e123e6899 on hv-cinder-84112 May 23 15:45:03.694326 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [req-8d4e53d8-20d0-4872-88d5-678cf5417ad9 req-1510e77c-e1d4-4c4f-a083-99b39e78e863 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.266016 May 23 15:45:03.695551 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 560/1136] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:45:03.731416 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.policy [None req-4d66c4cf-6317-48cc-8b04-928ef4e70e71 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117974) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:03.739180 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-4d66c4cf-6317-48cc-8b04-928ef4e70e71 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1568 microversion: 2.1 time: 0.168288 May 23 15:45:03.739754 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 577/1137] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:45:03 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:45:04.757484 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-efa54bc6-03fb-470a-87e8-3e8734ddfae6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:04.758230 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-efa54bc6-03fb-470a-87e8-3e8734ddfae6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:04.765071 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-efa54bc6-03fb-470a-87e8-3e8734ddfae6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:04.765520 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-efa54bc6-03fb-470a-87e8-3e8734ddfae6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:04.766284 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-efa54bc6-03fb-470a-87e8-3e8734ddfae6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:04.766715 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-efa54bc6-03fb-470a-87e8-3e8734ddfae6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:04.999256 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-efa54bc6-03fb-470a-87e8-3e8734ddfae6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:05.006732 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-efa54bc6-03fb-470a-87e8-3e8734ddfae6 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1568 microversion: 2.1 time: 0.253941 May 23 15:45:05.007309 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 561/1138] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:45:04 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:05.951226 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [req-b8628361-7f2a-4947-bc04-a72391d3a072 req-da111bbe-b122-48b2-a6e1-3c2bc5e1c95c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff4ee13-17c0-4b09-abc7-488e123e6899", "name": "network-vif-deleted", "tag": "300409dc-55b8-410d-b8c1-b461d6270c87"}]} {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:05.960257 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-b8628361-7f2a-4947-bc04-a72391d3a072 req-da111bbe-b122-48b2-a6e1-3c2bc5e1c95c service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:05.960705 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [req-b8628361-7f2a-4947-bc04-a72391d3a072 req-da111bbe-b122-48b2-a6e1-3c2bc5e1c95c service nova] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:05.971975 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.compute.server_external_events [req-b8628361-7f2a-4947-bc04-a72391d3a072 req-da111bbe-b122-48b2-a6e1-3c2bc5e1c95c service nova] Creating event network-vif-deleted:300409dc-55b8-410d-b8c1-b461d6270c87 for instance dff4ee13-17c0-4b09-abc7-488e123e6899 on hv-cinder-84112 May 23 15:45:05.977223 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [req-b8628361-7f2a-4947-bc04-a72391d3a072 req-da111bbe-b122-48b2-a6e1-3c2bc5e1c95c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031899 May 23 15:45:05.978324 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 578/1139] 10.222.0.30 () {64 vars in 1317 bytes} [Mon May 23 15:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:45:06.023590 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-d9fd0c5b-9f36-467b-be56-f3b66d651c89 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:06.024202 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.compute.api [None req-d9fd0c5b-9f36-467b-be56-f3b66d651c89 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117973) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:06.030898 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d9fd0c5b-9f36-467b-be56-f3b66d651c89 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:06.031350 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d9fd0c5b-9f36-467b-be56-f3b66d651c89 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:06.032369 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d9fd0c5b-9f36-467b-be56-f3b66d651c89 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:06.032803 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG oslo_concurrency.lockutils [None req-d9fd0c5b-9f36-467b-be56-f3b66d651c89 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:06.094862 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.policy [None req-d9fd0c5b-9f36-467b-be56-f3b66d651c89 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec46cf4f87241a2a4581e34c154f5a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe810dde94644f57b3b6262366c8f126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117973) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:06.102544 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-d9fd0c5b-9f36-467b-be56-f3b66d651c89 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 200 len: 1220 microversion: 2.1 time: 0.082900 May 23 15:45:06.103390 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 562/1140] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:45:06 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:07.120857 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-22d210b4-94be-4163-b1a6-dbf0c65bba31 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '>' {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:07.121623 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.compute.api [None req-22d210b4-94be-4163-b1a6-dbf0c65bba31 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] [instance: dff4ee13-17c0-4b09-abc7-488e123e6899] Fetching instance by UUID {{(pid=117974) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:07.127790 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-22d210b4-94be-4163-b1a6-dbf0c65bba31 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:07.128234 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-22d210b4-94be-4163-b1a6-dbf0c65bba31 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:07.129016 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-22d210b4-94be-4163-b1a6-dbf0c65bba31 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:07.129452 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG oslo_concurrency.lockutils [None req-22d210b4-94be-4163-b1a6-dbf0c65bba31 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Lock "f40d0327-0eaf-46c7-bb5c-33377a3083ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:07.143106 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.wsgi [None req-22d210b4-94be-4163-b1a6-dbf0c65bba31 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] HTTP exception thrown: Instance dff4ee13-17c0-4b09-abc7-488e123e6899 could not be found. May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-22d210b4-94be-4163-b1a6-dbf0c65bba31 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Request method failure captured: May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: request: GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 HTTP/1.1 May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept: application/json May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Accept-Encoding: identity May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Connection: close May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Length: 0 May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Content-Type: application/json May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Host: 10.222.0.30 May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Openstack-System-Scope: None May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: User-Agent: python-urllib3/1.26.9 May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Auth-Token: gAAAAABii6r2QviEjTBGEjwiCODqw-JXRhTOTiFUH1hrtRhny79ZHuAgZV91FaGf-wXUM5DF8ZQMfqZTGVth6fMvFFWiiLDY2AZsGuu_kThl9DLeVPXrn2jGxO1pDSHOPYeMKbepwICtWZ11Mb5eKnsM8KD42yQw9RuSYLMH_eNjDUaHzf0rdAg May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Id: None May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Domain-Name: None May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Identity-Status: Confirmed May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Is-Admin-Project: True May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Id: default May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Domain-Name: Default May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Id: fe810dde94644f57b3b6262366c8f126 May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Project-Name: tempest-TestShelveInstance-1140834625 May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Role: member,reader May 23 15:45:07.144684 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Roles: member,reader May 23 15:45:07.146481 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fe810dde94644f57b3b6262366c8f126"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fe810dde94644f57b3b6262366c8f126"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fe810dde94644f57b3b6262366c8f126"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fe810dde94644f57b3b6262366c8f126", "adminURL": "http://10.222.0.30:8080"}]}] May 23 15:45:07.146481 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant: tempest-TestShelveInstance-1140834625 May 23 15:45:07.146481 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Id: fe810dde94644f57b3b6262366c8f126 May 23 15:45:07.146481 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-Tenant-Name: tempest-TestShelveInstance-1140834625 May 23 15:45:07.146481 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User: tempest-TestShelveInstance-1140834625-project May 23 15:45:07.146481 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Id: default May 23 15:45:07.146481 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Domain-Name: Default May 23 15:45:07.146481 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Id: aec46cf4f87241a2a4581e34c154f5a8 May 23 15:45:07.146481 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: X-User-Name: tempest-TestShelveInstance-1140834625-project May 23 15:45:07.146481 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: method: > May 23 15:45:07.146481 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: exception: Instance dff4ee13-17c0-4b09-abc7-488e123e6899 could not be found. May 23 15:45:07.146481 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: action_args: {'id': 'dff4ee13-17c0-4b09-abc7-488e123e6899'} May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: {{(pid=117974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dff4ee13-17c0-4b09-abc7-488e123e6899 could not be found. May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:45:07.147544 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dff4ee13-17c0-4b09-abc7-488e123e6899 could not be found. May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dff4ee13-17c0-4b09-abc7-488e123e6899 could not be found. May 23 15:45:07.149355 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: ERROR nova.api.openstack.wsgi May 23 15:45:07.151793 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: DEBUG nova.api.openstack.wsgi [None req-22d210b4-94be-4163-b1a6-dbf0c65bba31 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Returning 404 to user: Instance dff4ee13-17c0-4b09-abc7-488e123e6899 could not be found. {{(pid=117974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:45:07.151793 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO nova.api.openstack.requestlog [None req-22d210b4-94be-4163-b1a6-dbf0c65bba31 tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899" status: 404 len: 111 microversion: 2.1 time: 0.030198 May 23 15:45:07.151793 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: [pid: 117974|app: 0|req: 579/1141] 10.222.0.30 () {58 vars in 1235 bytes} [Mon May 23 15:45:07 2022] GET /compute/v2.1/servers/dff4ee13-17c0-4b09-abc7-488e123e6899 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:45:07.303102 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: DEBUG nova.api.openstack.wsgi [None req-1cb44503-f478-4cf3-bbcb-4cbc117a334b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] Calling method '.version_select at 0x7f0d7a1f5af0>' {{(pid=117973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:07.323865 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO nova.api.openstack.requestlog [None req-1cb44503-f478-4cf3-bbcb-4cbc117a334b tempest-TestShelveInstance-1140834625 tempest-TestShelveInstance-1140834625-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1488814699" status: 202 len: 0 microversion: 2.1 time: 0.024384 May 23 15:45:07.324413 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: [pid: 117973|app: 0|req: 563/1142] 10.222.0.30 () {58 vars in 1253 bytes} [Mon May 23 15:45:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1488814699 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:45:14.336677 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:45:14.337441 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Mon May 23 15:45:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:46:30.531456 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:46:30.532124 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Mon May 23 15:46:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:46:44.489799 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:46:44.490448 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Mon May 23 15:46:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:48:27.251160 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:48:27.251671 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Mon May 23 15:48:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:48:34.346135 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:48:34.346960 dv-cinder-841125-8-iscsi devstack@n-api.service[117973]: Mon May 23 15:48:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:49:50.540240 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:49:50.540714 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Mon May 23 15:49:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:50:04.498240 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:50:04.499070 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Mon May 23 15:50:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:50:10.932779 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:50:10.932779 dv-cinder-841125-8-iscsi devstack@n-api.service[117974]: Mon May 23 15:50:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!